Quantize/dither image using ImageMagick commands on image style actions
Imagecache actions has a 'custom' action which allows you to run your own actions. It may help you, though I used it years ago on a drupal 6 site with GD so can not say for certain if it will work for you.