RedHatAI
/

DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

nm-research commited on Feb 20

Commit

16b7d5b

·

verified ·

1 Parent(s): c2f5b24

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -272,7 +272,7 @@ The following performance benchmarks were conducted with [vLLM](https://docs.vll
 <summary>Benchmarking Command</summary>
 ```
-guidellm --model neuralmagic/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16 --target "http://localhost:8000/v1" --data-type emulated --data "prompt_tokens=<prompt_tokens>,generated_tokens=<generated_tokens>" --max seconds 360 --backend aiohttp_server
 ```
 </details>

 <summary>Benchmarking Command</summary>
 ```
+guidellm --model neuralmagic/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic --target "http://localhost:8000/v1" --data-type emulated --data "prompt_tokens=<prompt_tokens>,generated_tokens=<generated_tokens>" --max seconds 360 --backend aiohttp_server
 ```
 </details>