 Harris was a native of Dorchester, Massachusetts.His father, Thaddeus Mason Harris, was a Unitarian minister who served at the church on Meeting House Hill and had also for a time served as librarian of Harvard.Harris himself received his undergraduate education at Harvard, and then went on to study medicine there, receiving his M.D.