1 Tonsil stones form when bacteria, food particles, and other debris collect in the grooves of your tonsils, then harden into a calcified mass.  The hard, white or yellow lumps attract sulfur-containing bacteria that give off an unpleasant odor, causing bad breath.