Gelbert, who was born in Scranton, Pennsylvania, attended Wissahickon High School in Ambler, Pennsylvania and graduated from Lebanon Valley College in 1928.
Gelbert began his professional career in 1926 with the minor league Syracuse Stars.