In 1869, a high granite pyramid was built as a memorial to the more than 18,000 enlisted men of the Confederate Army buried in the cemetery.
In 1890, a chapel was constructed next to the entrance of the cemetery.