Dorjai was born in the village of Gya in Ladakh, in the High Himalayas. He had a semi-nomadic childhood, spending half of the month tending his family's herd of yaks and cashmere goats, while attending school during the other half.