Update README.md
Browse files
README.md
CHANGED
@@ -41,6 +41,7 @@ Also, check out our dataset as well on [this page](https://huggingface.co/datase
|
|
41 |
|
42 |
## Prompt Format
|
43 |
Prometheus requires 4 components in the input: An instruction, a response to evaluate, a score rubric, and a reference answer. You could refer to the prompt format below.
|
|
|
44 |
```
|
45 |
###Task Description:
|
46 |
An instruction (might include an Input inside it), a response to evaluate, a reference answer that gets a score of 5, and a score rubric representing a evaluation criteria are given.
|
@@ -69,6 +70,7 @@ Score 5: {score5_description}
|
|
69 |
###Feedback:
|
70 |
```
|
71 |
|
|
|
72 |
|
73 |
## License
|
74 |
Feedback Collection and Prometheus is subject to OpenAI's Terms of Use for the generated data. If you suspect any violations, please reach out to us.
|
|
|
41 |
|
42 |
## Prompt Format
|
43 |
Prometheus requires 4 components in the input: An instruction, a response to evaluate, a score rubric, and a reference answer. You could refer to the prompt format below.
|
44 |
+
You should fill in the instruction, response, reference answer, criteria description, and score description for score in range of 1 to 5.
|
45 |
```
|
46 |
###Task Description:
|
47 |
An instruction (might include an Input inside it), a response to evaluate, a reference answer that gets a score of 5, and a score rubric representing a evaluation criteria are given.
|
|
|
70 |
###Feedback:
|
71 |
```
|
72 |
|
73 |
+
As a result, a feedback and score decision will be generated, divided by a separating phrase ```[RESULT]```
|
74 |
|
75 |
## License
|
76 |
Feedback Collection and Prometheus is subject to OpenAI's Terms of Use for the generated data. If you suspect any violations, please reach out to us.
|