Chris's picture

1 115

Chris

HyperAutomata

·

AI & ML interests

None yet

Recent Activity

reacted to lewtun's post with 🔥 16 days ago

We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open! 🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1. 🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code. 🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training. Follow along: https://github.com/huggingface/open-r1

liked a model about 2 months ago

deepseek-ai/DeepSeek-V3-Base

liked a Space 3 months ago

llamameta/Pixtral-Large-Instruct-2411

View all activity

Organizations

None yet

HyperAutomata's activity

upvoted a paper 5 months ago

InkubaLM: A small language model for low-resource African languages

Paper • 2408.17024 • Published Aug 30, 2024 • 13