John Graham was born in Dundee, Scotland.
At the age of 16, John was commissioned in the British Army, joining the 90th Regiment of Foot, which had been raised in 1794 by his kinsman, Thomas Graham of Balgowan (later Lord Lynedoch).