Pogue was born in Shaker Heights, Ohio, the son of Richard Welch Pogue, an attorney and former managing partner at Jones, Day, Reavis & Pogue, and Patricia Ruth Raney.
Pogue graduated from Yale University in 1985 summa cum laude, earning a bachelor's degree in music .