Zhang

Minjia's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored 11 papers 9 days ago

Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs

Paper • 2310.01801 • Published Oct 3, 2023 • 3

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies

Paper • 2310.04610 • Published Oct 6, 2023 • 1

ZeRO-Offload: Democratizing Billion-Scale Model Training

Paper • 2101.06840 • Published Jan 18, 2021

Computing in the Era of Large Generative Models: From Cloud-Native to AI-Native

Paper • 2401.12230 • Published Jan 17, 2024 • 1

DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales

Paper • 2308.01320 • Published Aug 2, 2023 • 45

DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale

Paper • 2201.05596 • Published Jan 14, 2022 • 2

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Paper • 2211.05100 • Published Nov 9, 2022 • 29

Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers

Paper • 2211.11586 • Published Nov 17, 2022 • 1

Universal Checkpointing: Efficient and Flexible Checkpointing for Large Scale Distributed Training

Paper • 2406.18820 • Published Jun 27, 2024

Model Tells You Where to Merge: Adaptive KV Cache Merging for LLMs on Long-Context Tasks

Paper • 2407.08454 • Published Jul 11, 2024

DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scale

Paper • 2207.00032 • Published Jun 30, 2022

authored a paper about 1 month ago

Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey

Paper • 2412.18619 • Published Dec 16, 2024 • 54

published an article about 2 months ago

view article

Article

Bamba: Inference-Efficient Hybrid Mamba2 Model

Dec 18, 2024

• 43

authored a paper 7 months ago

UltraEdit: Instruction-based Fine-Grained Image Editing at Scale

Paper • 2407.05282 • Published Jul 7, 2024 • 13

authored a paper over 1 year ago

DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models

Paper • 2309.14509 • Published Sep 25, 2023 • 18

upvoted a paper over 1 year ago

DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention

Paper • 2309.14327 • Published Sep 25, 2023 • 22

authored a paper over 1 year ago

DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention

Paper • 2309.14327 • Published Sep 25, 2023 • 22