How to clear "Face sets"?
In the Face Sets menu, go to Face Set from Visible. As long as everything is visible, this should clear the existing face sets.

This turns everything in one single Face Set which is not shown colored: