Transformer-based interpretation Methods that depend on the transformer architecture primarily make use of the attention mechanism. We here redefine the methods proposed by Qiang et al. . Vaswani et al. defined the multi-head attention α l h ∈ R h×S×dh of layer l ∈ (0, ..., L) (Eq. 1). Later usage of α i,j corresponds to the values averaged over all heads. Furthermore, the output of each layer in the encoder is denoted as o l ∈ R S×E is defined in Eq. 2.