Sargent was born in Gloucester, Massachusetts and graduated from Harvard College before the Revolution.
In 1786, he helped to survey the Seven Ranges, the first lands laid out under the Land Ordinance of 1785.