“Acne-like bumps on the buttocks are caused by inflammation of hair follicles, which is called folliculitis,” says MacKelfresh. Folliculitis can be caused by an infection from bacteria, yeast, or fungus, irritation of hair follicles, or blockage of hair follicles, she says.