Another reason for prostate pain is prostatitis, an infection of the prostate that is often caused by bacteria. Symptoms of prostatitis may vary from person to person, but general symptoms include burning with urination, the inability to empty the bladder completely, and painful urination.