Spaces:

ttomy
/

proxy-lite-demo-for-setup

Running

XanderJC commited on Feb 17

Commit

0eff0a1

1 Parent(s): b287eb9

notice

Files changed (1) hide show

README.md CHANGED Viewed

@@ -99,7 +99,7 @@ vllm serve --model convergence-ai/proxy-lite \
 The tool arguments are **very important** for parsing the tool calls from the model appropriately.
-> **Important:** To run this, install vLLM and transformers with `uv sync --all-extras`. Qwen-2.5-VL Support in `transformers` is not yet available in the latest release so is done from source.
 You can set the `api_base` to point to your local endpoint when calling Proxy Lite:

 The tool arguments are **very important** for parsing the tool calls from the model appropriately.
+> **Important:** To serve the model locally, install vLLM and transformers with `uv sync --all-extras`. Qwen-2.5-VL support is not yet available in the latest release of `transformers` so installation from source is required.
 You can set the `api_base` to point to your local endpoint when calling Proxy Lite: