The band took their name from the Bombay Hills in northern New Zealand. The hills are traditionally the boundary between Auckland city and the rest of the country, and to be from south of the Bombays colloquially means not to be from Auckland.