XanderJC commited on
Commit
09d390b
·
1 Parent(s): 6bce7b2
Files changed (1) hide show
  1. README.md +47 -9
README.md CHANGED
@@ -1,8 +1,42 @@
1
- ![Proxy-Lite Logo](assets/proxy-lite.png)
2
 
3
- A mini, open-weights version of our Proxy assistant.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
 
5
- ![Proxy-Lite Demo](assets/demo.gif)
6
 
7
  ---
8
 
@@ -37,17 +71,16 @@ playwright install
37
  ```bash
38
  proxy --help
39
  ```
40
-
41
- You can directly run the proxy with:
42
 
43
  ```bash
44
  proxy "Book a table for 2 at an Italian restaurant in Kings Cross tonight at 7pm."
45
  ```
46
 
47
 
48
- ### Proxy-Lite Endpoint
49
 
50
- By default, Proxy-Lite will point to an endpoint set up on HuggingFace spaces. This is a demo endpoint and is not suitable for production use; it may be very slow when under heavy load.
51
 
52
  We recommend hosting your own endpoint with vLLM, you can use the following command:
53
 
@@ -59,7 +92,11 @@ vllm serve --model convergence-ai/proxy-lite-7b \
59
  --port 8008 \
60
  ```
61
 
62
- You can set the `api_base` to point to your local endpoint when calling Proxy-Lite:
 
 
 
 
63
 
64
  ```bash
65
  proxy --api-base http://localhost:8008/v1 "Book a table...
@@ -70,7 +107,7 @@ or by setting the environment variable:
70
  export PROXY_LITE_API_BASE=http://localhost:8008/v1
71
  ```
72
 
73
- ### Scaffolding Proxy-Lite in Python
74
 
75
  We use the `RunnerConfig` to control the setup of the task.
76
  The library is designed to be modular and extendable, you can easily swap the environment, solver, or agent.
@@ -124,3 +161,4 @@ If you want to not use this set-of-marks approach, you can set the `no_pois_in_i
124
 
125
 
126
 
 
 
1
+ <div align="center">
2
 
3
+ <img src="assets/proxy-lite.png" alt="Proxy Lite logo" width="400" height="auto" />
4
+
5
+ <p>
6
+ A mini, open-weights version of our Proxy assistant.
7
+ </p>
8
+
9
+
10
+ <!-- Badges -->
11
+ <p>
12
+ <a href="https://github.com/convergence-ai/proxy-lite/contributors">
13
+ <img src="https://img.shields.io/github/contributors/convergence-ai/proxy-lite" alt="contributors" />
14
+ </a>
15
+ <a href="">
16
+ <img src="https://img.shields.io/github/last-commit/convergence-ai/proxy-lite" alt="last update" />
17
+ </a>
18
+ <a href="https://github.com/convergence-ai/proxy-lite/network/members">
19
+ <img src="https://img.shields.io/github/forks/convergence-ai/proxy-lite" alt="forks" />
20
+ </a>
21
+ <a href="https://github.com/convergence-ai/proxy-lite/stargazers">
22
+ <img src="https://img.shields.io/github/stars/convergence-ai/proxy-lite" alt="stars" />
23
+ </a>
24
+ <a href="https://github.com/convergence-ai/proxy-lite/issues/">
25
+ <img src="https://img.shields.io/github/issues/convergence-ai/proxy-lite" alt="open issues" />
26
+ </a>
27
+ <a href="https://github.com/convergence-ai/proxy-lite/blob/master/LICENSE">
28
+ <img src="https://img.shields.io/github/license/convergence-ai/proxy-lite.svg" alt="license" />
29
+ </a>
30
+ </p>
31
+
32
+ </div>
33
+
34
+
35
+
36
+
37
+
38
+ ![Proxy Lite Demo](assets/demo.gif)
39
 
 
40
 
41
  ---
42
 
 
71
  ```bash
72
  proxy --help
73
  ```
74
+ You can directly run Proxy Lite on a task with:
 
75
 
76
  ```bash
77
  proxy "Book a table for 2 at an Italian restaurant in Kings Cross tonight at 7pm."
78
  ```
79
 
80
 
81
+ ### Proxy Lite Endpoint
82
 
83
+ By default, Proxy Lite will point to an endpoint set up on HuggingFace spaces. This is a demo endpoint and is not suitable for production use; it may be very slow when under heavy load.
84
 
85
  We recommend hosting your own endpoint with vLLM, you can use the following command:
86
 
 
92
  --port 8008 \
93
  ```
94
 
95
+ The tool arguments are **very important** for parsing the tool calls from the model appropriately.
96
+
97
+ > **Important:** To run this, install vLLM and transformers with `uv sync --all-extras`. `Qwen-2.5-VL` Support in `transformers` is not yet available in the latest release so is done from source.
98
+
99
+ You can set the `api_base` to point to your local endpoint when calling Proxy Lite:
100
 
101
  ```bash
102
  proxy --api-base http://localhost:8008/v1 "Book a table...
 
107
  export PROXY_LITE_API_BASE=http://localhost:8008/v1
108
  ```
109
 
110
+ ### Scaffolding Proxy Lite in Python
111
 
112
  We use the `RunnerConfig` to control the setup of the task.
113
  The library is designed to be modular and extendable, you can easily swap the environment, solver, or agent.
 
161
 
162
 
163
 
164
+