In 1830 Rev. Philip O’Reilly was sent by Bishop John Dubois to establish missions and build churches along the Hudson River wherever there were sufficient resident Catholics. O’Reilly visited the village of Saugerties, in Ulster County in 1832 and began holding services in private homes. The area was home to many Irish residents working in industry, a large number of which were Catholics, and as a result, the village here became the location of the first Catholic church in the county. Father O’Reilly founded St. Mary’s in 1833 creating the first parish of the Hudson, spanning New York City to Albany, with the cornerstone of the new church laid that same year; though, the church would be dedicated a decade later. The church cemetery grew from the first graves around the church in 1833 to fill much of the church property now occupied setting the Gothic edifice in a sea of gravestones. The church grew and eventually the steeple was added in the 1860s. It is also said that the church basement was used as a stop on the Underground Railroad. The church (like many in the United States) has struggled to maintain its large campus, which originally contained the church, a school, and convent, but the church remains in good condition, shining like a beacon on a hill on the Hudson.