Drury was born on September 2, 1918 in Houston, Texas, to Alden Monteith Drury (1895-1975), a citrus industry manager, real estate broker, and insurance agent, and Flora Allen (1894-1973), a legislative representative for the California Parent-Teacher Association [REF].
Allen Stuart Drury grew up in Porterville, California and earned his B.A. at Stanford University, where he joined Alpha Kappa Lambda, in 1939.