Qiang et al. further expanded research by Selvaraju et al. by using the class-activated gradients. Here, classactivated gradients are denoted using ∇ ω y c with ω being the position with respect to which the gradients are calculated and y c is the index of the output corresponding to the class of interest c (in our case toxic or non-toxic). This was then used in the interpretation method of the attention layers (Eq. 5). Firstly, similarly to the attention maps, by using the last layer or a specific layer to explain the entire model. Furthermore, Qiang et al. expanded this by summing over all layers and combining the gradients with the raw attention (Eq. 6).