NbAiLab
/

nb-llama-3.2-3B-configtest

Text Generation

🇪🇺 Region: EU

Model card Files Files and versions Community

pere commited on Jan 13

Commit

ab5fc59

·

verified ·

1 Parent(s): b38e491

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -21,7 +21,7 @@
   "pretraining_tp": 1,
   "rms_norm_eps": 1e-05,
   "rope_scaling": {
-    "factor": 16.0,
     "high_freq_factor": 4.0,
     "low_freq_factor": 1.0,
     "original_max_position_embeddings": 8192,

   "pretraining_tp": 1,
   "rms_norm_eps": 1e-05,
   "rope_scaling": {
+    "factor": 32.0,
     "high_freq_factor": 4.0,
     "low_freq_factor": 1.0,
     "original_max_position_embeddings": 8192,