Gustav0-Freind
/

LLaMA-Mesh

mesh-generation

Model card Files Files and versions Community

Gustav0-Freind commited on May 11

Commit

c34bae2

·

verified ·

1 Parent(s): c2894e3

Update config.json

Files changed (1) hide show

config.json +2 -2

config.json CHANGED Viewed

@@ -23,9 +23,9 @@
   "pretraining_tp": 1,
   "rms_norm_eps": 1e-05,
   "rope_scaling": {
-  "type": "llama3",
   "factor": 8.0
-  },
   "rope_theta": 500000.0,
   "tie_word_embeddings": false,
   "torch_dtype": "bfloat16",

   "pretraining_tp": 1,
   "rms_norm_eps": 1e-05,
   "rope_scaling": {
+  "type": "dynamic",
   "factor": 8.0
+  }
   "rope_theta": 500000.0,
   "tie_word_embeddings": false,
   "torch_dtype": "bfloat16",