Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models
Paper
•
2501.13629
•
Published
•
44
Fredi PRO
Fredithefish
AI & ML interests
LLMs, Audio, Diffusion Models
Recent Activity
liked
a model
22 days ago
perplexity-ai/r1-1776
liked
a model
29 days ago
agentica-org/DeepScaleR-1.5B-Preview
liked
a dataset
29 days ago
open-r1/OpenR1-Math-220k
Organizations
Fredithefish's activity
upvoted
a
paper
about 1 month ago
upvoted
2
articles
5 months ago
Article
Fixing Gradient Accumulation
•
51
Article
How to build a custom text classifier without days of human labeling
By
and 4 others
•
•
55
upvoted
5
papers
5 months ago
Self-Rewarding Language Models
Paper
•
2401.10020
•
Published
•
147
Law of the Weakest Link: Cross Capabilities of Large Language Models
Paper
•
2409.19951
•
Published
•
54
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration
Paper
•
2410.02367
•
Published
•
48
RATIONALYST: Pre-training Process-Supervision for Improving Reasoning
Paper
•
2410.01044
•
Published
•
36
VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment
Paper
•
2410.01679
•
Published
•
25
upvoted
an
article
6 months ago
Article
wHy DoNt YoU jUsT uSe ThE lLaMa ToKeNiZeR??
By
•
•
40
upvoted
a
paper
7 months ago