 Over time the Baile Hill site was abandoned in favour of the first castle site, leaving only the motte, which still exists.Henry II visited York Castle four times during his reign.The royal chambers at the time were inside the keep for safety, and Henry paid £15 for repairs to the keep.