SmolFactory / requirements /requirements.txt
Tonic's picture
adds scheduler stuff and hopes for the best with track tonic
d455d12
# Core dependencies - essential for training
torch>=2.0.0
transformers>=4.53.0
datasets>=2.14.0
accelerate>=0.20.0
trl>=0.7.0
# Hugging Face ecosystem
huggingface-hub>=0.16.0
tokenizers>=0.13.0
# Training and optimization
flash-attn>=2.0.0
bitsandbytes>=0.41.0
torchao>=0.10.0
# Basic utilities
numpy>=1.24.0
tqdm>=4.65.0
# Experiment tracking
# trackio>=0.1.0
gradio>=5.0.0
# Optional: for evaluation (commented out to reduce conflicts)
# lighteval>=0.1.0
# evaluate>=0.4.0
# Optional: for deployment (commented out to reduce conflicts)
# vllm>=0.2.0
# sentencepiece>=0.1.99
# Development tools (commented out to reduce conflicts)
# pytest>=7.0.0
# black>=23.0.0
# isort>=5.12.0
# System monitoring
psutil>=5.9.0