Exercise can exacerbate the burning sensation in knee. Rheumatoid arthritis is an autoimmune condition where the body attacks its own tissues and causes joint inflammation. Knee bursitis occurs when there is an inflammation in the fluid-filled sac in the knee joint.