Unusual for an African American born in this era, Proctor's grandparents on both sides had received a university education: his paternal grandmother had attended Hampton Institute, and both of his maternal grandparents had attended Norfolk Mission College.
Proctor graduated from high school in 1937 and enrolled at Virginia State College, having won a music scholarship to attend.