How to create an ensemble that gives precedence to a specific classifier
Feature-Weighted Linear Stacking might be what you are looking for.


  FWLS combines model predictions linearly using coefficients that are
  themselves linear functions of meta-features.


In your example you can use the meta-feature "Does A label the example as True?"