Removing Joint Compound with Paint Over It
The only way you'll get at the joint compound is to remove the paint. Products exist to dissolve even dried latex paint, or you can sand or scrape it off. Once that's done, a simple damp cloth will allow you to rub away the joint compound.