This Georgian mansion has all of the grandeur you’d expect from the area, but is delightfully un-fusty, says Harriet Brewis