Update README.md
Browse files
README.md
CHANGED
@@ -132,13 +132,13 @@ Install our [python library](https://github.com/root-signals/rs-python-sdk):
|
|
132 |
pip install root-signals
|
133 |
```
|
134 |
|
135 |
-
Import
|
136 |
```python
|
137 |
from root import RootSignals
|
138 |
client = RootSignals()
|
139 |
```
|
140 |
|
141 |
-
Create
|
142 |
```python
|
143 |
my_custom_judge = client.evaluators.create(
|
144 |
name="Political Text Evaluator",
|
@@ -146,7 +146,10 @@ my_custom_judge = client.evaluators.create(
|
|
146 |
predicate="Assess if a text containts political jargon or talks about politics: {{response}}",
|
147 |
model="RootJudge",
|
148 |
)
|
|
|
149 |
|
|
|
|
|
150 |
result = my_custom_judge.run(
|
151 |
response="A defence spending target of 3% of GDP is more likely than the 5% aim pushed by US President Donald Trump, say members of the parliamentary Defence Committee."
|
152 |
)
|
@@ -156,8 +159,7 @@ print(result.justification) # detailed reasoning for the score
|
|
156 |
|
157 |
## 3.2 Locally
|
158 |
|
159 |
-
We recommend using [SGLang](https://github.com/sgl-project/sglang) for production use together with *xml tags* for important sections in your prompt.
|
160 |
-
While the model runs on 80GB VRAM the effective context size (around 7k total tokens) will be too low for evaluating most RAG inputs.
|
161 |
|
162 |
SGlang example for a single Nvidia H100 (80GB):
|
163 |
```bash
|
|
|
132 |
pip install root-signals
|
133 |
```
|
134 |
|
135 |
+
Import:
|
136 |
```python
|
137 |
from root import RootSignals
|
138 |
client = RootSignals()
|
139 |
```
|
140 |
|
141 |
+
Create a custom evaluator powered by **Root Judge**:
|
142 |
```python
|
143 |
my_custom_judge = client.evaluators.create(
|
144 |
name="Political Text Evaluator",
|
|
|
146 |
predicate="Assess if a text containts political jargon or talks about politics: {{response}}",
|
147 |
model="RootJudge",
|
148 |
)
|
149 |
+
```
|
150 |
|
151 |
+
Execute:
|
152 |
+
```python
|
153 |
result = my_custom_judge.run(
|
154 |
response="A defence spending target of 3% of GDP is more likely than the 5% aim pushed by US President Donald Trump, say members of the parliamentary Defence Committee."
|
155 |
)
|
|
|
159 |
|
160 |
## 3.2 Locally
|
161 |
|
162 |
+
We recommend using [SGLang](https://github.com/sgl-project/sglang) for production use-cases together with *xml tags* for important sections in your prompt. While the model can run on 80GB VRAM, we recommend at least 96GB for evaluating long-context RAG inputs.
|
|
|
163 |
|
164 |
SGlang example for a single Nvidia H100 (80GB):
|
165 |
```bash
|