After the Revolution, Washington’s secretary, Colonel Cary lived in the house for two years and in 1790 William Woodbridge kept a boarding and day school in the house. In 1804 the estate was returned to Isaac Royall Jr.’s heir, his granddaughter Elizabeth (Royall) Hutton, who sold the estate to Robert Fletcher for £16,000 in 1806.
Fletcher, in turn, sold portions of the property to a group of investors, and it was eventually sold (in 1810) to Jacob and Ruth (Dawes) Tidd. Jacob Tidd was a successful rum distiller in Medford who owned a fashionable home in Boston. The Royall estate was intended to be a summer home for him and his family, and he purchased many acres of land surrounding the house, which he used for the cultivation of flowers and fruit trees. After he passed away in 1821, Ruth Tidd lived in the house year-round until she died 40 years later in 1861. The house passed through several hands after this, and by the end of the 19th century had fallen into disrepair.