4. Rinse the baking soda and vinegar off the tile with clean water. If water spots remain, repeat the process. When the tile is clean, dry it with a towel to prevent minerals in the rinse water from leaving new spots.ou can remove water stains with nontoxic household items. As hard water dries on your ceramic tile, it leaves a film or buildup of minerals behind. Harsh cleaners or scouring substances can scratch or scuff ceramic tile, but mild household items can dissolve water spots without damaging the surface.