autogen/website/blog/2023-07-14-Local-LLMs/index.md
interacting with multiple local LLMs  If you would like to interact with multiple LLMs on your local machine, replace the `model_worker` step above with a multi model variant:  ```bash python -m fastchat.serve.multi_model_worker \     --model-path lmsys/vicuna-7b-v1.3 \     --model-names vicuna-7b-v1.3 \     --model-path chatglm2-6b \     --model-names chatglm2-6b ```  The inference code would be:  ```python from autogen import oai  # create a chat completion request response = oai.ChatCompletion.create(     config_list=[         {             "model": "chatglm2-6b",             "base_url": "http://localhost:8000/v1",             "api_type": "openai",             "api_key": "NULL",         },         {             "model": "vicuna-7b-v1.3",             "base_url": "http://localhost:8000/v1",             "api_type": "openai",             "api_key": "NULL",         }     ],     messages=[{"role": "user", "content": "Hi"}] ) print(response) ``` 