MistralVLLM / entrypoint.sh
SuperSecureHuman's picture
Create entrypoint.sh
35bbfea
raw
history blame
214 Bytes
python3 -m fastchat.serve.controller &
python3 -m fastchat.serve.model_worker --model-path mistralai/Mistral-7B-Instruct-v0.1 --device cpu &
python3 -m fastchat.serve.openai_api_server --host localhost --port 8000