Archer was born in Tchula, Mississippi, one of the six children of Eva Rutherford Archer and Chalmers Archer, Sr. His mother was a teacher and librarian and his father was a veteran of World War I and a farmer [REF].
When he was 12 years old, his family moved to Lexington, Mississippi.