Fast Video Generation with Sliding Tile Attention
Paper
•
2502.04507
•
Published
•
42
Simeon Emanuilov PRO
s-emanuilov
AI & ML interests
Software Engineer & Ph.D. candidate | Specializing in ML/DL system development & applying AI to solve real-world business problems.
Recent Activity
replied to
their
post
about 7 hours ago
Tutorial 💥 Training a non-English reasoning model with GRPO and Unsloth
I wanted to share my experiment with training reasoning models in languages other than English/Chinese.
Using Llama 3.1 8B as base, GRPO trainer from trl, and Unsloth optimizations, I got a working prototype in Bulgarian after ~5 hours on an L40S GPU. The approach should work for any language where the base model has some pre-training coverage.
Full code and tutorial here: https://unfoldai.com/reasoning-in-a-non-english-language/
The model itself: https://huggingface.co/s-emanuilov/LLMBG-Llama-3.1-8B-BG-Reasoning-v0.1
I hope this helps anyone looking to build reasoning models in their language.
upvoted
a
paper
1 day ago
Fast Video Generation with Sliding Tile Attention
replied to
their
post
2 days ago
Tutorial 💥 Training a non-English reasoning model with GRPO and Unsloth
I wanted to share my experiment with training reasoning models in languages other than English/Chinese.
Using Llama 3.1 8B as base, GRPO trainer from trl, and Unsloth optimizations, I got a working prototype in Bulgarian after ~5 hours on an L40S GPU. The approach should work for any language where the base model has some pre-training coverage.
Full code and tutorial here: https://unfoldai.com/reasoning-in-a-non-english-language/
The model itself: https://huggingface.co/s-emanuilov/LLMBG-Llama-3.1-8B-BG-Reasoning-v0.1
I hope this helps anyone looking to build reasoning models in their language.
Organizations
s-emanuilov's activity
upvoted
a
paper
1 day ago
upvoted
a
paper
3 days ago
upvoted
a
paper
6 days ago
upvoted
an
article
7 days ago
Article
Open-source DeepResearch – Freeing our search agents
•
912
upvoted
a
collection
8 days ago
upvoted
an
article
10 days ago
Article
Finally, a Replacement for BERT: Introducing ModernBERT
•
532
upvoted
an
article
14 days ago
Article
Welcome to Inference Providers on the Hub 🔥
•
321
upvoted
a
collection
16 days ago
upvoted
an
article
19 days ago
Article
SmolVLM Grows Smaller – Introducing the 250M & 500M Models!
•
124
upvoted
2
papers
20 days ago
upvoted
a
paper
21 days ago
upvoted
an
article
22 days ago
Article
Yay! Organizations can now publish blog Articles
By
and 3 others
•
•
33
upvoted
a
collection
22 days ago
upvoted
a
paper
22 days ago
upvoted
a
collection
25 days ago
upvoted
2
papers
26 days ago
upvoted
2
papers
27 days ago