ai4bharat
/

indic-bert

Inference Endpoints

Model card Files Files and versions Community

divkakwani commited on Mar 30, 2021

Commit

d20494f

·

1 Parent(s): 09d164a

Update config.json

Update max_position_embeddings to 128

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -7,7 +7,7 @@
   "hidden_size": 768,
   "initializer_range": 0.02,
   "intermediate_size": 3072,
-  "max_position_embeddings": 512,
   "num_attention_heads": 12,
   "num_hidden_layers": 12,
   "num_hidden_groups": 1,

   "hidden_size": 768,
   "initializer_range": 0.02,
   "intermediate_size": 3072,
+  "max_position_embeddings": 128,
   "num_attention_heads": 12,
   "num_hidden_layers": 12,
   "num_hidden_groups": 1,