Taxonomy images display in different view rows
Received answer from @Lendude on drupal forums here:


  Yeah, adding relationships will add rows, that is the way of SQL
  queries.
  
  If you enable aggregation and then group the results on the right
  column, that works in some use cases (make sure to set/save the column
  for your image field or you will run into this #2815881: Switching on
  aggregation on generates fatal "Column not found: 1054 Unknown
  column" SQL error when using multi-column Fields) Using the 'rendered
  entity' field with a specific view mode can work. This would possibly
  allow you to remove the relationship from the View itself.