Wash the site of the boil gently with warm water and soap, and keep it clean until the wound heals. After you get rid of boils, the area might be a little bit irritated or raw for awhile; take vitamin E and A supplements to promote the regrowth of healthy fresh skin in the area.