Collection by
5 days ago
5 days ago
-
Attention Heads of Large Language Models: A Survey
Paper • 2409.03752 • Published • 89 -
Transformer Explainer: Interactive Learning of Text-Generative Models
Paper • 2408.04619 • Published • 159 -
Addition is All You Need for Energy-efficient Language Models
Paper • 2410.00907 • Published • 146 -
DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining
Paper • 2305.10429 • Published • 3
