Release ingrown hairs Razor bumps can be caused by ingrown hairs. These are hairs that are growing out but curl back into the skin and penetrate it, causing inflammation, pimple-like bumps, irritation, and itching. Exfoliating your skin before shaving can remove dead skin and help prevent ingrown hairs.