Change shown fields in a grouped view depending on group
These types of problems are often solved by creating another Views display. 


Add a Filter to your original Views to only show the results with the terms where you want to show the additional fields. 
Then Duplicate this display as Attachment, attach it to the original views display. 
Override the Attachment Filters and change the one for the terms - reverse the choices to filter out only the terms where you don't want additional fields 
Override the Attachment Fields, remove the ones you don't want. 


The Attachment results will display below or above the original results, depending on whether you choose to attach it After or Before.