Richard Varick Dey (1801-1837) was a young divinity student from New York City, attending the Theological Seminary in New Brunswick, New Jersey, when he met Lavinia Agnes Scott (1805-1886). Dey was the son of prominent New York attorney Anthony Dey and Catharine Laidlie; Catherine’s father, the Rev. Archibald Laidlie, was the first minister called to preach in English in the Dutch Church in New York City. Richard and Lavinia fell in love and became engaged on December 27, 1820. However, Lavinia’s parents were opposed to Richard, and her father even asked Richard’s theology professors at Rutgers to try to discourage his pursuit of Lavinia. It did not work and they married in September 1822. After graduating from the Seminary in 1822, Richard was licensed by the Congregationalists and the young couple moved to Greenfield Hill, in Fairfield, Connecticut, where he preached from 1822-1829. Local history states that it was actually Lavinia who designed this house in 1823 for their family and oversaw the builders during its construction. The Federal style house stands out for its clear Dutch form with its roof projecting to create a recessed verandah, likely influenced by the couple’s New York/New Jersey upbringing.

Reverend Dey, Lavinia, and their children relocated to New York City, and Richard preached at a number of churches the before he died unexpectedly in 1837, leaving his 32-year-old widow with four young children. Lavinia remained in New York, where she served as the manager of The Society for the Relief of Poor Widows with Small Children for over 25 years. She never would remarry and died in 1886.