 The new castle was used to hold French prisoners taken in at Poitiers in 1357 , including John II , who was held for a considerable ransom . Later in the century , the castle also found favour with Richard II . Richard conducted restoration work on St George 's Chapel , the work being carried out by Geoffrey Chaucer , who served as a diplomat and Clerk of The King 's Works . 
