Joel Benedict Erhardt was born in Pottstown, Pennsylvania and moved with his parents, John Erhardt and Louisa Benedict, to New York City at the age of three.
He initially joined the Ninth Militia Regiment, but reportedly anxious for active duty, he left the unit for the Second and then Seventy-First Regiments until finally leaving for the front lines with the Seventh Regiment.