 He was the son of Sidney Sweet and Hannah (née Redmond) Sweet.He attended the common schools and Dansville Seminary.He graduated from the literary department of Yale College in 1871, where he was a member of Skull and Bones.