title: How can I use attn_output_weights for next attention blocks?
body: <p><code>nn.MultiheadAttention</code> able to return mysterious thing called attn_output_weights. My problem is to transfer results of <code>MultiHeadAttention</code> block to next iterations to keep attention results through them (frame by frame evaluation of audio, let’s say). How can I use those weights as input (initial state) for <code>nn.MultiheadAttention</code>? Or I should use something different for this task?</p>