 Hulsey was born in DeKalb County, Georgia, and passed the Georgia bar in 1859, but didn't practice much until after the Civil War.With Georgia's secession, Hulsey enlisted in April 1861 as a private in the "State Guards," which soon became Company F of the 6th Georgia Infantry.That unit saw no action before Hulsey left them in early 1862, when he returned home and was elected major of the newly raised 42nd Georgia Infantry on March 20.