Baptized David Jackson Kemper by Dr. Benjamin Moore, the Assistant Rector of his parents' congregation at New York City's Trinity Church, he would eventually drop the given name "David."
He entered Columbia College at the age of fifteen, where he studied theology under Dr. Henry Hobart and graduated in 1809 as the valedictorian of his class.