A chalky white substance on your vinyl siding and trim is caused by oxidation, which occurs most often during damp or wet weather. Oxidation can be cleaned from most vinyl siding, but the process can be time-consuming and labor-intensive.