The most common condition leading to vaginal bumps is folliculitis. This is a skin infection at the base of a hair follicle, much like a pimple. It can occur anywhere on the labia and is quite tender, but it's nothing to be concerned about. Bartholin cysts form at the bottom of the vaginal opening.