

Multimodal GPT. An abstraction that extends OpenAI’s GPT architecture for multimodal generation when combined with the generation utility.


MultiHeadAttention. A critical component for attention-based models with support for fast auto-regressive decoding.

