 Under King John the castle was part of the lands forming the jointure of his second wife Isabella . John entrusted the castle to Geoffrey Fitz Peter in 1206 , who rebuilt much of the town . Geoffrey died in 1213 and the castle passed to his son , John Fitzgeoffrey . 
