 Construction of Durham Castle began in 1072 , which makes it the oldest building in use at any University in the world . The castle retains much of its original design and structure , and is part of a UNESCO World Heritage Site with Durham Cathedral . 
