Born in Charlestown, Massachusetts, Devens graduated from Boston Latin School and eventually Harvard College in 1838, and from the Harvard Law School in 1840.
Devens practiced law at Worcester, Massachusetts, from 1853 until 1861.