Ouz-G commited on
Commit
df283dd
·
verified ·
1 Parent(s): c8fcd88

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -132,13 +132,13 @@ Install our [python library](https://github.com/root-signals/rs-python-sdk):
132
  pip install root-signals
133
  ```
134
 
135
- Import our library:
136
  ```python
137
  from root import RootSignals
138
  client = RootSignals()
139
  ```
140
 
141
- Create your custom judge with custom instructions and run evaluation:
142
  ```python
143
  my_custom_judge = client.evaluators.create(
144
  name="Political Text Evaluator",
@@ -146,7 +146,10 @@ my_custom_judge = client.evaluators.create(
146
  predicate="Assess if a text containts political jargon or talks about politics: {{response}}",
147
  model="RootJudge",
148
  )
 
149
 
 
 
150
  result = my_custom_judge.run(
151
  response="A defence spending target of 3% of GDP is more likely than the 5% aim pushed by US President Donald Trump, say members of the parliamentary Defence Committee."
152
  )
@@ -156,8 +159,7 @@ print(result.justification) # detailed reasoning for the score
156
 
157
  ## 3.2 Locally
158
 
159
- We recommend using [SGLang](https://github.com/sgl-project/sglang) for production use together with *xml tags* for important sections in your prompt. At least 96GB of VRAM is recommended.
160
- While the model runs on 80GB VRAM the effective context size (around 7k total tokens) will be too low for evaluating most RAG inputs.
161
 
162
  SGlang example for a single Nvidia H100 (80GB):
163
  ```bash
 
132
  pip install root-signals
133
  ```
134
 
135
+ Import:
136
  ```python
137
  from root import RootSignals
138
  client = RootSignals()
139
  ```
140
 
141
+ Create a custom evaluator powered by **Root Judge**:
142
  ```python
143
  my_custom_judge = client.evaluators.create(
144
  name="Political Text Evaluator",
 
146
  predicate="Assess if a text containts political jargon or talks about politics: {{response}}",
147
  model="RootJudge",
148
  )
149
+ ```
150
 
151
+ Execute:
152
+ ```python
153
  result = my_custom_judge.run(
154
  response="A defence spending target of 3% of GDP is more likely than the 5% aim pushed by US President Donald Trump, say members of the parliamentary Defence Committee."
155
  )
 
159
 
160
  ## 3.2 Locally
161
 
162
+ We recommend using [SGLang](https://github.com/sgl-project/sglang) for production use-cases together with *xml tags* for important sections in your prompt. While the model can run on 80GB VRAM, we recommend at least 96GB for evaluating long-context RAG inputs.
 
163
 
164
  SGlang example for a single Nvidia H100 (80GB):
165
  ```bash