 His family moved to Vermont in 1817 and settled in Ludlow, Vermont in 1825.Washburn attended the public schools of Ludlow and Black River Academy, then attended Dartmouth College.He graduated in 1835, and was a member of Phi Beta Kappa.