autogen/website/docs/topics/non-openai-models/local-vllm.md
Running vLLM proxy server  To run vLLM with the chosen model and our chat template, in your terminal:  ```bash python -m vllm.entrypoints.openai.api_server --model mistralai/Mistral-7B-Instruct-v0.2 --chat-template autogenmistraltemplate.jinja ```  By default, vLLM will run on 'http://0.0.0.0:8000'. 