Rho-1: Not All Tokens Are What You Need
Paper
•
2404.07965
•
Published
•
90
Interesting Papers
-
-
LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders
Paper • 2404.05961 • Published • 65 -
Compression Represents Intelligence Linearly
Paper • 2404.09937 • Published • 27 -
Multi-Head Mixture-of-Experts
Paper • 2404.15045 • Published • 60 -
Stylus: Automatic Adapter Selection for Diffusion Models
Paper • 2404.18928 • Published • 15 -
LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report
Paper • 2405.00732 • Published • 120 -
Your Transformer is Secretly Linear
Paper • 2405.12250 • Published • 151 -
Diffusion Models Are Real-Time Game Engines
Paper • 2408.14837 • Published • 123 -
Writing in the Margins: Better Inference Pattern for Long Context Retrieval
Paper • 2408.14906 • Published • 140 -
Differential Transformer
Paper • 2410.05258 • Published • 169 -
Addition is All You Need for Energy-efficient Language Models
Paper • 2410.00907 • Published • 145 -
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
Paper • 2501.12948 • Published • 315 -
s1: Simple test-time scaling
Paper • 2501.19393 • Published • 99