adding context length var to config.json, this is the same var used in bamaba v2 9b (#6)

- adding context length var to config.json, this is the same var used in bamaba v2 9b (dc98421992c73dfee5ac7a9583c70fe7aad957e6)


Co-authored-by: Ryan Mangeno <[email protected]>

config.json

@@ -25,6 +25,7 @@
   "mamba_n_groups": 1,
   "mamba_n_heads": 128,
   "mamba_proj_bias": false,
+  "max_position_embeddings": 4096,
   "model_type": "bamba",
   "num_attention_heads": 32,
   "num_hidden_layers": 32,