 Gumpert remained in baseball for another 39 years, managing in the Yankees' farm system (1956–1958 and 1960) and working as a minor league pitching instructor.He served as a temporary member of the Bombers' coaching staff, when, in April, Bill Dickey stepped down due to ill health; Gumpert eventually ceded his coaching post to Charlie Keller.He turned to scouting for the Yankees in 1959 (signing Doc Medich among others), and later worked for the Major League Baseball Scouting Bureau for two decades.