Niklas Hoepner
commited on
Commit
·
4718ad2
1
Parent(s):
320889f
Update app
Browse files
app.py
CHANGED
@@ -108,7 +108,7 @@ with gr.Blocks() as demo:
|
|
108 |
)
|
109 |
|
110 |
print(score)
|
111 |
-
# {'L3Score': 0.49...}
|
112 |
```
|
113 |
|
114 |
---
|
@@ -128,9 +128,9 @@ with gr.Blocks() as demo:
|
|
128 |
Calling the `compute` method returns a dictionary containing the L3Score:
|
129 |
|
130 |
```python
|
131 |
-
{"L3Score": float}
|
132 |
```
|
133 |
-
The value is the **average score** over all (question, prediction, reference) triplets.
|
134 |
|
135 |
---
|
136 |
|
@@ -147,7 +147,7 @@ with gr.Blocks() as demo:
|
|
147 |
provider="openai",
|
148 |
model="gpt-4o-mini"
|
149 |
)
|
150 |
-
# {'L3Score': 0.99...}
|
151 |
|
152 |
score = l3score.compute(
|
153 |
questions=["What is the capital of Germany?"],
|
@@ -157,7 +157,7 @@ with gr.Blocks() as demo:
|
|
157 |
provider="openai",
|
158 |
model="gpt-4o-mini"
|
159 |
)
|
160 |
-
# {'L3Score': 0.00...}
|
161 |
```
|
162 |
---
|
163 |
|
|
|
108 |
)
|
109 |
|
110 |
print(score)
|
111 |
+
# {'L3Score': 0.49..., 'Cost': ...}
|
112 |
```
|
113 |
|
114 |
---
|
|
|
128 |
Calling the `compute` method returns a dictionary containing the L3Score:
|
129 |
|
130 |
```python
|
131 |
+
{"L3Score": float, "Cost": float}
|
132 |
```
|
133 |
+
The value is the **average score** over all (question, prediction, reference) triplets and the total cost of all API calls.
|
134 |
|
135 |
---
|
136 |
|
|
|
147 |
provider="openai",
|
148 |
model="gpt-4o-mini"
|
149 |
)
|
150 |
+
# {'L3Score': 0.99..., 'Cost': ...}
|
151 |
|
152 |
score = l3score.compute(
|
153 |
questions=["What is the capital of Germany?"],
|
|
|
157 |
provider="openai",
|
158 |
model="gpt-4o-mini"
|
159 |
)
|
160 |
+
# {'L3Score': 0.00..., 'Cost': ...}
|
161 |
```
|
162 |
---
|
163 |
|