Spaces:

nroggendorff
/

train-llama

Runtime error

nroggendorff commited on Jul 26, 2024

Commit

0fc1ac4

verified ·

1 Parent(s): 0877d39

Update train.py

Files changed (1) hide show

train.py CHANGED Viewed

@@ -12,7 +12,7 @@ BATCH_SIZE = 256
 EPOCHS = 1
 LEARNING_RATE = 1e-4
 FP16 = True
-FACTOR = 2
 VOCAB_SIZE = 3200
 INPUT_DATASET = "nroggendorff/elephant"
 OUTPUT_REPO = "smallama"

 EPOCHS = 1
 LEARNING_RATE = 1e-4
 FP16 = True
+FACTOR = 1
 VOCAB_SIZE = 3200
 INPUT_DATASET = "nroggendorff/elephant"
 OUTPUT_REPO = "smallama"