Sumner received his elementary education in Norfolk, Virginia, and Plainfield, New Jersey.
He then returned to Lincoln University as a graduate student and as a teacher of religious study, psychology, philosophy, and German.