Article
FastRTC: The Real-Time Communication Library for Python
•
143
transformers
in dedicated releases!v4.49.0-SmolVLM-2
and v4.49.0-SigLIP-2
.┌─────────────────────────┐
│ Input Layer │
├─────────────────────────┤
│ Token & Positional │
│ Embedding │
├─────────────────────────┤
│ 12x Transformer │
│ Blocks │
│ - 12 heads │
│ - 768 hidden dims │
│ - 3072 intermediate │
├─────────────────────────┤
│ Output Layer │
└─────────────────────────┘
for CntLayer := 1 to {Layers=}12 do
begin
Result.AddTransformerBlockCAI(
{Heads=}12,
{intermediate dimensions=}4*768,
{NoForward=}true,
{HasNorm=}true,
false
);
end;