Hugging Face's logo

Inference Optimization
community
Activity Feed

AI & ML interests

None defined yet.

Recent Activity

krishnateja95  updated a model about 14 hours ago
inference-optimization/Qwen3-Next-80B-A3B-Instruct-FP8-block
krishnateja95  updated a model about 14 hours ago
inference-optimization/Qwen3-Next-80B-A3B-Thinking-FP8-block
krishnateja95  updated a model about 14 hours ago
inference-optimization/Qwen3-Next-80B-A3B-Thinking-quantized.w4a16
View all activity

inference-optimization 's collections 4

Mixed Precision Models
Collection of Mixed Precision LLaMA and Qwen Models
Qwen3-Next-80B-A3B Quantized Models
FP8-dynamic, FP8-block, NVFP4, INT4, INT8 versions of Qwen3-Next-80B-A3B-Instruct and Qwen3-Next-80B-A3B-Thinking Models
KV Cache Quantization
Collection on FP8 Quantization of Weights, Activations and KV Cache
Qwen3-Next-80B-A3B Quantized Models
FP8-dynamic, FP8-block, NVFP4, INT4, INT8 versions of Qwen3-Next-80B-A3B-Instruct and Qwen3-Next-80B-A3B-Thinking Models
Mixed Precision Models
Collection of Mixed Precision LLaMA and Qwen Models
KV Cache Quantization
Collection on FP8 Quantization of Weights, Activations and KV Cache