Taxonomy Term View not showing image field Drupal 7, Views 3

I have created a Taxonomy Term View for a particular vocabulary. If I set the Format Show option to "Fields", and add the Taxonomy name and image fields, then for some reason only the name shows. If I change it to "Rendered entity" then everything works fine. Another weirdness: this is only for some vocabularies - for some other vocabularies, the fields option works just fine (it shows the image). Any thoughts on why this might be? Any ideas how to debug this? Thanks guys.
Heh, well, as said in the comment, be sure to either have the same field or add all image fields :)