Dutton was born in 1838 in Wallingford, Connecticut, to Samuel Dutton (1806-1851) and his wife Emily (Curtis) Dutton (1805-1875).
On September 1, 1857, Dutton entered the United States Military Academy at West Point, and graduated 3rd out of 34 cadets on June 24, 1861.