llm-course-hw1 / config.json
Lexu3A's picture
Push model using huggingface_hub.
c5f13f1 verified
{
"dropout": 0.1,
"hidden_dim": 96,
"intermediate_dim": 256,
"max_seq_len": 128,
"n_head": 4,
"n_kv_head": 2,
"n_layer": 3,
"vocab_size": 1024
}