 There are 38 Grade I listed buildings in Taunton Deane . The oldest buildings are churches built before the end of the 12th century , and the Castle Bow , which has been incorporated into the Castle Hotel in Taunton but was originally a gateway into Taunton Castle . The castle was created between 1107 and 1129 , when William <unk> , the Chancellor of King Henry I , fortified the bishop 's hall . It was his successor , Henry of <unk> , who transformed the manor @-@ house into a castle in 1138 , during the Civil War that raged during the reign of his brother , King Stephen . Taunton is also the site of Gray 's <unk> , which dates from <unk> , and two buildings in Fore Street from the 16th century . Many of the more recent structures in the list are manor houses such as <unk> Manor and <unk> Barton which were built in <unk> in the 15th century . <unk> Park and <unk> Manor were both built in the 16th century and <unk> Court in 1755 . 
