Harvey was the son of a grocer and worked as a salesman after attending Hinchley Wood School in Surrey.
A chance meeting with Canon William Lummis led him to take over his life-work of researching and documenting the final resting places of all Victoria Cross recipients.