As the son of James and Maurine Coleman, he spent his early childhood in Bedford, Indiana, but he moved to Louisville, Kentucky.
He initially enrolled to study chemistry but became interested in sociology and continued his graduate studies at Columbia University.