Nelson was born in Hebron, New York on November 10, 1792, the son of Scotch-Irish immigrants John Rodgers Nelson and Jean McArthur.
Upon graduation in 1813, Nelson decided on a legal career and read law at the firm of John Savage and David Woods in Salem, New York.