Update README.md

README.md

@@ -15,7 +15,10 @@ base_model: mgoin/Nemotron-4-340B-Base-hf
 
 Converted and quantized checkpoint of [nvidia/Nemotron-4-340B-Base](https://huggingface.co/nvidia/Nemotron-4-340B-Base). Specifically it was produced from the [v1.2 .nemo checkpoint on NGC](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/nemotron-4-340b-base/files?version=1.2).
 
-This runs in vLLM with this PR: https://github.com/vllm-project/vllm/pull/6611
+You can deploy this model with `vllm>=0.5.4` ([PR#6611](https://github.com/vllm-project/vllm/pull/6611)):
+```
+vllm serve mgoin/Nemotron-4-340B-Instruct-hf --tensor-parallel-size 16
+```
 
 ### Evaluations