Spaces:

nroggendorff
/

train-llama

Runtime error

nroggendorff commited on Nov 9, 2024

Commit

ee162e7

verified ·

1 Parent(s): eb2ea54

Update train.py

Files changed (1) hide show

train.py CHANGED Viewed

@@ -169,7 +169,7 @@ def train_model(model, tokenizer, dataset, push, isinst):
         weight_decay=WEIGHT_DECAY,
         gradient_accumulation_steps=GRADIENT_ACCUMULATION_STEPS,
         fp16=FP16,
-        save_steps=WARMUP_STEPS,
         logging_steps=WARMUP_STEPS,
         eval_strategy="no",
         eval_steps=1,

         weight_decay=WEIGHT_DECAY,
         gradient_accumulation_steps=GRADIENT_ACCUMULATION_STEPS,
         fp16=FP16,
+        save_steps=WARMUP_STEPS * 5,
         logging_steps=WARMUP_STEPS,
         eval_strategy="no",
         eval_steps=1,