Spaces:

nroggendorff
/

train-llama

Runtime error

nroggendorff commited on Aug 13, 2024

Commit

3ea2c30

verified ·

1 Parent(s): 1d8f422

Update train.py

Files changed (1) hide show

train.py CHANGED Viewed

@@ -17,7 +17,7 @@ INPUT_DATASET = "HuggingFaceTB/smollm-corpus"
 INSTRUCT_DATASET = "nroggendorff/elephant"
 OUTPUT_REPO = "smallama"
 FP16 = False
-WARMUP_STEPS = 20
 DECAY = 0
 GRADIENT_ACCUMULATION_STEPS = 1
 PUSH_TO_HUB = True

 INSTRUCT_DATASET = "nroggendorff/elephant"
 OUTPUT_REPO = "smallama"
 FP16 = False
+WARMUP_STEPS = 200
 DECAY = 0
 GRADIENT_ACCUMULATION_STEPS = 1
 PUSH_TO_HUB = True