Update README.md
Browse files
README.md
CHANGED
|
@@ -65,6 +65,8 @@ docker run --name athene-v2-agent \
|
|
| 65 |
|
| 66 |
You can now submit any OpenAI-Compatible tool-use requests to the model by hitting the VLLM endpoint. Athene-V2-Agent will be able to issue tool calls that you can execute and return results for.
|
| 67 |
|
|
|
|
|
|
|
| 68 |
### Examples
|
| 69 |
|
| 70 |
An example Weather agent for this can be found here: [Link](example/vllm_v2_weather_agent.py#L186-L193). This example includes handling Athene for queries that are answerable and not answerable by the current tools.
|
|
|
|
| 65 |
|
| 66 |
You can now submit any OpenAI-Compatible tool-use requests to the model by hitting the VLLM endpoint. Athene-V2-Agent will be able to issue tool calls that you can execute and return results for.
|
| 67 |
|
| 68 |
+
|
| 69 |
+
**WARNING**: Athene-V2-Agent uses a *CUSTOM* prompting style that is baked into the custom docker image. For best performance, please ensure to use the docker image above for Athene-V2-Agent. Using HuggingFace tokenizer's chat template will yield suboptimal results for Agent usecases.
|
| 70 |
### Examples
|
| 71 |
|
| 72 |
An example Weather agent for this can be found here: [Link](example/vllm_v2_weather_agent.py#L186-L193). This example includes handling Athene for queries that are answerable and not answerable by the current tools.
|