Herman Gref was born in the Kazakh Soviet Socialist Republic (now Kazakhstan) into a family of ethnic German deportees who were exiled there in 1941.
He then moved to Leningrad (now Saint Petersburg) and taught law at Leningrad University until completing his post-graduate degree in 1993.