 His father, a graduate of Morgan State University, moved the family to Baltimore, in 1952, to take a job as the Dean of men at Morgan State University and assistant rector at the St. James' Episcopal Church.Anderson's parents divorced in 1957 and he and his two sisters were raised by his mother.Anderson attended primary schools in Baltimore and Glencoe, Illinois.