Lum was born in Honolulu, Hawaii to a Japanese woman and American soldier, and was adopted as a baby by a Chinese couple, Mun Luke and Winnifred Lum.
A speedy runner, Lum was converted to an outfielder in the Braves' organization after having played first base in high school.