Built in 1800 on the former 300-acre property of financier Robert Morris, the house was named "Lemon Hill" after the lemon trees in the home's greenhouse. It is a Federal-style mansion built by Henry Pratt, a merchant who owned a fleet of ships and speculated in real estate.