

Codebook layers which compresses high dimensional data by nearest neighbor lookup in an embedding space and is a vital component of VQVAEs (provided as a model in the repository).


Shifted-window Attention window based multi-head self attention which is a vital component of encoders like Swin 3D Transformers.


Components for CLIP. A popular model published by OpenAI which has proven to be extremely effective at learning text and image representations.

