Officially, the island was Yerba Buena Island until 1895, when on a decision by the United States Board on Geographic Names, it was changed to Goat Island.
During World War II, Yerba Buena Island fell under the jurisdiction of Treasure Island Naval Station, main headquarters of the 12th Naval District inside Building One.