Spaces:

nroggendorff
/

train-llama

Runtime error

nroggendorff commited on Oct 9, 2024

Commit

2be1eee

verified ·

1 Parent(s): 22f2f59

Update train.py

Files changed (1) hide show

train.py CHANGED Viewed

@@ -11,7 +11,7 @@ from torch.utils.data import DataLoader
 from torch.cuda.amp import autocast, GradScaler
 from itertools import islice
-BATCH_SIZE = 1
 EPOCHS = 1
 LEARNING_RATE = 1e-4
 FACTOR = 768

 from torch.cuda.amp import autocast, GradScaler
 from itertools import islice
+BATCH_SIZE = 8
 EPOCHS = 1
 LEARNING_RATE = 1e-4
 FACTOR = 768