In 1861, he enlisted in the Confederate army, and was commissioned as the colonel of the 1st Georgia Infantry.
Mercer commanded the 10th Battalion, Georgia Infantry, which was charged with the defense of the Savannah area.