The XAI methods of IG and SHAP were used using captum . All other methods were re-implemented. Methods are described in Table . For XAI methods that use a specific layer for their interpretation (Attention Maps, Grads), we used the last layer averaged over all attention heads. Furthermore, the original implementations of Grads and AttGrads, and CAT and AttCAT were re-implemented using the PyTorch autograd system instead of hooks as in the original implementation . re-implemented Eq. 8