Worlebury Hill is bordered on its north and west sides by steep cliffs dropping down into the Bristol Channel between Weston Bay and Sand Bay. These would have rendered the fort nearly invulnerable to attack from those directions. Nevertheless, the fort still has one wall on its north side and one on its west side, both very near the edge of the cliffs. On the south side, a single rampart and a ditch guarded the fort. The level east side was protected by two stone ramparts and five ditches. Parts of these ramparts were over high measuring from the bottom of the ditch as of 1875.