Soak the caulk with household bleach cleaner. Allow the cleaner to sit on the caulk for 10 to 15 minutes. Scrub the area with a damp sponge to remove any stubborn stains. Don't use a hard bristle brush or scouring pad as they may remove the caulk. Rinse the caulk thoroughly with warm water.