Kelly was apprenticed to the mason's trade, and engaged in business for himself at the age of twenty-one.
During Kelly's time as sheriff, his wife and children died and he left New York for an extended overseas trip.