deepseek-ai

/

DeepSeek-R1-Distill-Qwen-32B

like 996

Follow

DeepSeek 31.8k

S/he meant of course distilling DeepSeek R1 using Qwen2.5 72B as the student model (if you still have some GPUs left for that:)
(We only have the smaller-sized Qwen2.5 32B used in that role, but not 72B, which may explain why that distillation using Qwen 32B was beaten on many benchmarks by the distillation using the 100% larger 70B Llama 3.x as the student model)