SmolFactory / requirements /requirements_minimal.txt
Tonic's picture
adds scheduler stuff and hopes for the best with track tonic
d455d12
raw
history blame
250 Bytes
# Minimal requirements for SmolLM3 training
torch>=2.0.0
transformers>=4.53.0
datasets>=2.14.0
accelerate>=0.20.0
trl>=0.7.0
huggingface-hub>=0.16.0
tokenizers>=0.13.0
# flash-attn>=2.0.0
bitsandbytes>=0.41.0
numpy>=1.24.0
tqdm>=4.65.0
psutil>=5.9.0