The first fortification was erected by Haakon V Magnusson in 1306 and was called Varghøya.
The second fortification to be built was in Østervågen (the "East Bay") which was erected between 1450 and 1500.