Is it posible to use taxonomy terms in Context module?
Take a look at 
Using Block Visibility Groups to Create Conditional Layouts in Drupal 8 about solution,
and the
Term condition module,

it works for me.