Input Parameters

Hidden size:


Intermediate size:


Vocab size:


Number of key-value heads:


Number of attention (query) heads:


Number of hidden layers:


Include bias?
No Yes

Calculate