Two colonies were established by penguins in the 1980s on the mainland near Cape Town at Boulders Beach near Simon 's Town and Stony Point in Betty 's Bay . Two colonies were established by penguins in the 1980s on the mainland near Cape Town , namely Boulders Beach near Simon 's Town and Stony Point in Betty 's Bay .