Local attention
Longformer uses local attention: often, the local context (e.g., what are the two tokens to the
left and right?)