Lary enrolled at Texas A&M University, where he played college football for the Texas A&M Aggies football team from 1949 to 1951.
Lary also starred in baseball as an outfielder for the Texas A&M baseball team.