Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
AdinaYΒ 
posted an update 24 days ago

The sparse attention is available here by the amazing lucidrains:

https://github.com/lucidrains/native-sparse-attention-pytorch

In this post