hook_field_prepare_view not called
As documentation says:


  This hook is invoked before the field values are handed to formatters for display


It will not be called when content is served from cache - as values are not handed anywhere, it's just output taken from cache table (or other cache bin) and sent to display.