Article
How to Optimize TTFT of 8B LLMs with 1M Tokens to 20s
By
•
•
2Huiqiang Jiang PRO
iofu728
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
14 days ago
Optimizing Large Language Model Training Using FP4 Quantization
liked
a model
16 days ago
Qwen/Qwen2.5-14B-Instruct-1M
upvoted
a
paper
19 days ago
Sigma: Differential Rescaling of Query, Key and Value for Efficient
Language Models
Organizations
