wyu97 commited on
Commit
91ff777
·
1 Parent(s): d80236b
Files changed (1) hide show
  1. README.md +22 -0
README.md CHANGED
@@ -1,3 +1,25 @@
1
  ---
2
  license: cc-by-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-4.0
3
  ---
4
+
5
+ # FiD model trained on NQ
6
+
7
+ -- This is the model checkpoint of FiD [2], based on the T5 (with 3B parameters) and trained on the NQ dataset [1].
8
+
9
+ -- Hyperparameters: 8 x 40GB A100 GPUs; batch size 8; AdamW; LR 3e-5; 30000 steps
10
+
11
+ References:
12
+
13
+ [1] Natural Questions: A Benchmark for Question Answering Research. TACL 2019.
14
+
15
+ [2] Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering. EACL 2021.
16
+
17
+ ## Model performance
18
+
19
+ We evaluate it on the NQ dataset, the EM score is 50.6 on the test set.
20
+
21
+
22
+ <a href="https://huggingface.co/exbert/?model=bert-base-uncased">
23
+ <img width="300px" src="https://cdn-media.huggingface.co/exbert/button.png">
24
+ </a>
25
+