Townsend received his primary education at The Albany Academy, and his secondary education at the Rev. Dr. Dewey's Boarding School in Pittsfield, Massachusetts.
On June 19, 1850, Townsend married Harriet Munro, the daughter of Nathan Munro and Cynthia Champlin, of Elbridge, New York.