nm-testing
/

pixtral-12b-FP8-dynamic

Image-Text-to-Text

compressed-tensors

Model card Files Files and versions Community

shubhrapandit commited on Feb 25

Commit

10cc40b

·

verified ·

1 Parent(s): 661ab35

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -133,7 +133,7 @@ The model was evaluated on OpenLLM Leaderboard [V1](https://huggingface.co/space
 ## Inference Performance
-This model achieves up to xxx speedup in single-stream deployment and up to xxx speedup in multi-stream asynchronous deployment, depending on hardware and use-case scenario.
 The following performance benchmarks were conducted with [vLLM](https://docs.vllm.ai/en/latest/) version 0.7.2, and [GuideLLM](https://github.com/neuralmagic/guidellm).
 <details>

 ## Inference Performance
+This model achieves up to 1.80x speedup in single-stream deployment and up to 1.36x speedup in multi-stream asynchronous deployment, depending on hardware and use-case scenario.
 The following performance benchmarks were conducted with [vLLM](https://docs.vllm.ai/en/latest/) version 0.7.2, and [GuideLLM](https://github.com/neuralmagic/guidellm).
 <details>