the attention heads in the proposed adaptively sparse Transformer can specialize more and with higher confidence In particular, we analyzed how the attention heads in the proposed adaptively sparse Transformer can specialize more and with higher confidence. 
 Question: How does their model improve interpretability compared to softmax transformers?
the attention heads in the proposed adaptively sparse Transformer can specialize more and with higher confidence