tangledgroup
/

tangled-alpha-0.9-core

Text Generation

Model card Files Files and versions Community

mtasic85 commited on Mar 15

Commit

dbd968d

·

1 Parent(s): d1bfa72

cpt core 4

Files changed (1) hide show

scripts/cpt_core_model_4.py +1 -0

scripts/cpt_core_model_4.py CHANGED Viewed

@@ -108,6 +108,7 @@ trainer = UnslothTrainer(
         fp16=not is_bfloat16_supported(),
         bf16=is_bfloat16_supported(),
         logging_steps=1,
         # optim='adamw_8bit',
         optim='adamw_torch_fused',
         weight_decay=0.01,

         fp16=not is_bfloat16_supported(),
         bf16=is_bfloat16_supported(),
         logging_steps=1,
+        eval_steps=10,
         # optim='adamw_8bit',
         optim='adamw_torch_fused',
         weight_decay=0.01,