How can I solvent exchange from water to alcohol?
Since it's a colloid, rather than a true solution, put the water-based mixture in a dialysis membrane of appropriate pore size and immerse it in concentrated alcohol. The water will dissolve into the alcohol, while alcohol slowly seeps in to displace the water, but the colloidal particles cannot get through the pores. Depending on how little water is desired in the final product, this step may be repeated multiple times.

For some materials, inexpensive cellophane sausage casing may be suitable.