arxiv:2412.14590
Zhen Zheng
JamesTheZ
AI & ML interests
Large scale machine learning system optimization.
Recent Activity
commented on
a paper
about 2 months ago
MixLLM: LLM Quantization with Global Mixed-precision between
Output-features and Highly-efficient System Design
authored
a paper
about 2 months ago
MixLLM: LLM Quantization with Global Mixed-precision between
Output-features and Highly-efficient System Design
authored
a paper
about 2 months ago
BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix
Sharing and Throughput-oriented Token Batching
Organizations
None yet
models
None public yet
datasets
None public yet