He had seven sisters, whose names were Diana Annenberg (1900-1905), Esther "Aye" Annenberg Simon Levee (1901-1992), Janet Annenberg Hooker (1904-1997), Enid Annenberg Haupt (1906-2005), Lita Annenberg Hazen (1909-1995), Evelyn Annenberg Jaffe Hall (1911-2005), and Harriet Beatrice Annenberg Ames Aronson (1914-1969).
The Annenberg family moved to Long Island, New York, in 1920,[REF] and Walter attended high school at the Peddie School in Hightstown, New Jersey, graduating in 1927 [REF].