I already want to return to this historic town that has quietly built a reputation as one of the most desirable places to live in Britain.