And your pain might get worse before it gets better. Complications include infections or bleeding at the site of the injection. Serious side effects from an epidural steroid injection are rare. But they can include stroke, paralysis, or loss of vision.