Brims Ness is a promontory. The castle on it had three storeys and a garret. There was a square stair-wing with a watch-tower on top, but this was replaced by a pitched roof. The entrance at the junction of the main block and the stair jamb has a semi-circular open turret over it. There was a courtyard to the north, now filled with later buildings, which had a sea-gate.