Under Spanish and Mexican rule, the area was the site of a harbor named Yerba Buena Cove with a small civilian outpost named Yerba Buena that served to support the military population of the Presidio and the Mission Dolores.
With the onset of the Great Depression and statewide height restrictions due to earthquake fears, few new buildings were constructed, and the district remained relatively low-rise until the late 1950s.