Seelye was born on September 20, 1837, in Bethel, Connecticut, to Seth and Abigail (Taylor) Seelye.
Seelye married Henrietta Chapin, daughter of Lyman and Harriet (Sheldon) Chapin, of Albany, on November 17, 1863.