It is advised to rest and possibly take some of the painkillers to relieve the symptoms. Formation of the pilondial cyst above the tailbone could cause symptoms similar to yours. They include pain and swelling at the bottom of the spine, redness around the area, draining puss and possibly fever.