He is the father of Sir Edward Oliver Wheeler, who participated in the first topographical survey of Mount Everest in 1921, and as Brigadier in the British Army was appointed Surveyor General of India in 1941. He is the grandfather of John Oliver Wheeler, an award-winning Canadian geologist.