This building was constructed by Jabez Sargent Jr., the son of one of the original settlers of what is today known as Chester, Vermont. Jabez was a farmer who worked on the fields surrounding what would become his estate for years until he realized that his property was an ideal location for a tavern to host travelers making the journey between Boston and Montreal.
The Sargent House, also known as the Jeffrey House, is a rare example of the Georgian style in Vermont. The state of Vermont was actually contested land between nearby New Hampshire and New York, and the state was scarcely developed by the time Georgian architecture was in vogue. The building apparently featured a tavern in the raised basement and a ballroom on the middle floor. Jabez and his family would have occupied the upper story. The home is vernacular in that it has the scale and form of a Georgian style property, but lacks many high-style detailing besides the Palladian windows.