 In 1216 , when a Scottish army invaded the Eden valley and Alan of Galloway occupied Westmorland , Brougham Castle played no part in the county 's defence , probably because it was unfinished . Construction would have been suspended until Alan retreated in 1217 . Vieuxpont received control over the king 's revenues from Cumberland , and these helped fund the construction of the castle . Brougham Castle was constructed in the northern part of the old Roman fort , and stone from the ruins was probably used to help build the castle . When Robert de Vieuxpont died in 1228 , his only son – John – was a minor , so his property was taken into the care a warden . 
