 Initially Bridgwater faced competition from the established nearby port of Downend, protected by Down End Castle, but the new settlement rapidly became dominant.Bridgwater Castle was a substantial structure built in Old Red Sandstone from Wembdon with other stone being transported from Downend in the Polden Hills and Ham Hill by boat.The site covered 8 or 9 acres (32,000 to 36,000 m²).