Kilmer then competed in football for one year at Citrus Junior College, where he scored six touchdowns and threw for 15 more, with a broken foot limiting his playing time for the Citrus basketball team.
After the conclusion of a UCLA career that saw him finish among the top five in school history for passing and rushing yards, as well as total offense, Kilmer played in the 1961 College All-Star Game, where he earned Most Valuable Player honors.