Cotter grew up in a family of mixed racial heritage.
On July 22, 1891, Cotter married Maria F. Cox, a fellow teacher, with whom he had four children: Leonidas, Florence, Olivia, and Joseph Seamon Cotter Jr (a distinguished poet-playwright in his own merit) [REF].