However, in some cases simple kidney cysts can grow large enough and cause a dull pain in a person's back, side or upper abdomen. These cysts can also get infected, causing pain, fever and tenderness. They can burst, also causing pain. Simple kidney cysts rarely harm kidneys or impair their ability to function.