File size: 165 Bytes
c412427
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
{
    "dim_embed": 256,
    "dim_model": 256,
    "dim_feedforward": 1024,
    "num_layers": 4,
    "dropout": 0.1,
    "maxlen": 512,
    "flash_attention": false
}