Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,17 @@
|
|
| 1 |
---
|
| 2 |
license: gpl
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: gpl
|
| 3 |
+
tags:
|
| 4 |
+
- Document Question Answering
|
| 5 |
+
datasets:
|
| 6 |
+
- MP-DocVQA
|
| 7 |
language:
|
| 8 |
- en
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# BigBird-ITC-BASE fine-tuned on MP-DocVQA
|
| 12 |
+
|
| 13 |
+
This is BigBird-base trained on TriviaQA from [Google hub](https://huggingface.co/google/bigbird-base-trivia-itc) and fine-tuned on Multipage DocVQA (MP-DocVQA) dataset.
|
| 14 |
+
* Due to Huggingface implementation, the global tokens are defined according to the Internal Transformer Construction (ITC) strategy.
|
| 15 |
+
|
| 16 |
+
- Results on the MP-DocVQA dataset are reported in table 2.
|
| 17 |
+
- Training hyperparameters can be found in Table 8 of Appendix D
|