Hugging Face's logo
Varun Srivastava's picture
2 1 7

Varun Srivastava

varun4
21world's profile picture
·
https://do-me.github.io/SemanticFinder/

AI & ML interests

Working on embeddings. Check out in-browser Semantic Finder in the link above.

Recent Activity

upvoted a paper 1 day ago
Agency Is Frame-Dependent
reacted to lewtun's post with 🔥 15 days ago
We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open! 🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1. 🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code. 🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training. Follow along: https://github.com/huggingface/open-r1
reacted to lewtun's post with 🔥 15 days ago
We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open! 🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1. 🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code. 🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training. Follow along: https://github.com/huggingface/open-r1
View all activity

Organizations

UC Berkeley's profile picture

models

None public yet