Rebuild features on cache clear
Yes, it is best to disable this in production for the performance reasons mentioned.

I think the only times you would want to rebuild the feature list is when you are using the features and/or modules lists (as designed). Spending the resources to reload that when clearing cache for themeing purposes would be unnecessary.