Bumps on the Gums. These gumboils are also called parulis and are found around the teeth near the cheeks or lips and on the roof of the mouth. They are usually caused by a tooth with a nerve that died due infection and decay.