5fa1a76
1
2
3
Local attention Longformer uses local attention: often, the local context (e.g., what are the two tokens to the left and right?)
