File size: 817 Bytes
6658cfd de79d5e 6658cfd de79d5e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 |
---
license: wtfpl
datasets:
- ms_marco
- squad
language:
- en
---
# Model
t5-base-msmarco-squad-query-generation-firstp-v2
Task: query generation
Architecture: T5
Base model: t5-base
Note: This is supposed to be a baseline model.
## Prompt:
"Generate Query: {document}. Query:"
## Sequence length:
512 tokens
## Training details
### Hyperparameters
Batch size: 8;
Gradient acc: 8;
LR: 3e-4, linear scheduler, 400 warmup steps.
### Data
Total: 252059 pairs (document, query)
From MARCO-V2: 165238
From SQuAD: 86821
The remaining queries from MARCO-V2 train split were not used.
## Evaluation
This model is supposed to be used for data augmentation.
Hence, meaningful evaluation will come from downstream tasks.
MARCO-V2 Dev1:
BLEU: 0.105
ROUGE: 0.449
MARCO-V2 Dev2:
BLEU: 0.171
ROUGE: 0.503 |