 Built in 1838, the building was initially constructed as the residence of John Street, a son of the city's co-founder, Zadok Street.The Street family were Quakers and active in the Western Anti-slavery Society, an abolitionist organization then headquartered in Salem.Interested in aiding fleeing slaves, the Streets altered their residence after its initial construction, and provided food and clandestine lodging in several hiding spaces throughout the house.