model update
Browse files
README.md
CHANGED
@@ -14,11 +14,11 @@ pipeline_tag: text2text-generation
|
|
14 |
tags:
|
15 |
- question generation
|
16 |
widget:
|
17 |
-
- text: "
|
18 |
example_title: "Question Generation Example 1"
|
19 |
-
- text: "
|
20 |
example_title: "Question Generation Example 2"
|
21 |
-
- text: "
|
22 |
example_title: "Question Generation Example 3"
|
23 |
model-index:
|
24 |
- name: lmqg/mt5-small-dequad
|
@@ -70,8 +70,7 @@ model_path = 'lmqg/mt5-small-dequad'
|
|
70 |
pipe = pipeline("text2text-generation", model_path)
|
71 |
|
72 |
# Question Generation
|
73 |
-
|
74 |
-
question = pipe(input_text)
|
75 |
```
|
76 |
|
77 |
## Evaluation Metrics
|
@@ -81,7 +80,7 @@ question = pipe(input_text)
|
|
81 |
|
82 |
| Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
|
83 |
|:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
|
84 |
-
| [lmqg/qg_dequad](https://huggingface.co/datasets/lmqg/qg_dequad) | default | 0.
|
85 |
|
86 |
|
87 |
|
|
|
14 |
tags:
|
15 |
- question generation
|
16 |
widget:
|
17 |
+
- text: "<hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records."
|
18 |
example_title: "Question Generation Example 1"
|
19 |
+
- text: "Beyonce further expanded her acting career, starring as blues singer <hl> Etta James <hl> in the 2008 musical biopic, Cadillac Records."
|
20 |
example_title: "Question Generation Example 2"
|
21 |
+
- text: "Beyonce further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, <hl> Cadillac Records <hl> ."
|
22 |
example_title: "Question Generation Example 3"
|
23 |
model-index:
|
24 |
- name: lmqg/mt5-small-dequad
|
|
|
70 |
pipe = pipeline("text2text-generation", model_path)
|
71 |
|
72 |
# Question Generation
|
73 |
+
question = pipe('<hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.')
|
|
|
74 |
```
|
75 |
|
76 |
## Evaluation Metrics
|
|
|
80 |
|
81 |
| Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
|
82 |
|:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
|
83 |
+
| [lmqg/qg_dequad](https://huggingface.co/datasets/lmqg/qg_dequad) | default | 0.004 | 0.101 | 0.115 | 0.799 | 0.546 | [link](https://huggingface.co/lmqg/mt5-small-dequad/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_dequad.default.json) |
|
84 |
|
85 |
|
86 |
|