The son of musician and music historian Elkhonon Yoffe and Russian literature teacher Lidia Yoffe (nee Artiushina), Mark Yoffe was born in Riga, Latvia, then part of the Soviet Union.
On April 1, 1978, together with his parents and fox-terrier Lada, he left Latvia for the USA.