 He was born the son of Edward Holte of the Manor House, Duddeston, Warwickshire by his wife Dorothy Ferrars.The Holtes were a wealthy, land-owning family of some importance in Warwickshire.Their ancestors had owned land in the area for several hundred years and it had been considerably added to with the acquisition of monastic land during the Reformation.