Later it reverted to the Beaufort Estate and was then tenanted for various uses including a girls' boarding school, which it was when Archdeacon Coxe visited in 1798; Castle House 'now occupied by Mrs. Elizabeth Tudor, mistress of the most respectable school for young ladies in this part of England'.