Input Parameters

Hidden size:


Intermediate size:


Vocab size:


Number of key-value heads:


Number of attention heads:


Number of hidden layers:


Include bias?
Yes No

Calculate