Built five years before the Temple Ohabei Shalom in Brookline, the Temple Kehillath Israel on Harvard Street employs a similar architectural aesthetic of the Byzantine Revival style. The Jewish community of Brookline had grown significantly since the early 1900s, reaching a population of 4,000 by 1921. The congregation which constructed this temple had temporary quarters in a building at Harvard and Thorndike streets. By March 1921, it was decided to build a temple, and in 1922, the cornerstone was laid for a building which would cost an estimated $150,000 and have a capacity for 1,000. Plans submitted by architects architects Albert MacNaughton and George E. Robinson showed the large structure with space to build outbuildings as the congregation was expected to keep up with growth.

In 1948, an Art Deco Community House, designed by Samuel Glaser, was constructed of stone replicated the materiality of the temple, but with Modern features, a connector addition was added in 1958. The congregation is currently in the midst of a huge building campaign, which began with the exterior restoration of the temple building, followed by a modernization and restoration of the interior. In 2019, the 1948 Community House was razed to make way for an affordable housing development, called the Brown Family House.