Likely FLORES contamination for Claude 3 Opus (#29)
Browse files- Likely FLORES contamination for Claude 3 Opus (cd590c0664f3d3b0811d093f8ec453eba5f282bf)
- add PR number (7099363d6ef4a7a94e0d378d918d35efbfc9f65b)
- Set test set as contaminated (88324f54bf0a7946e502d9ffbd2e04866db7bb9f)
Co-authored-by: David Stap <[email protected]>
- contamination_report.csv +1 -0
contamination_report.csv
CHANGED
|
@@ -155,6 +155,7 @@ facebook/flores;;bigscience/mt0-small;;model;;100.0;;data-based;https://aclantho
|
|
| 155 |
facebook/flores;;bigscience/mt0-xl;;model;;100.0;;data-based;https://aclanthology.org/2023.acl-long.891/;20
|
| 156 |
facebook/flores;;bigscience/mt0-xxl;;model;;100.0;;data-based;https://aclanthology.org/2023.acl-long.891/;20
|
| 157 |
facebook/flores;;bigscience/xP3;;corpus;;100.0;;data-based;https://aclanthology.org/2023.acl-long.891/;20
|
|
|
|
| 158 |
|
| 159 |
gigaword;;EleutherAI/pile;;corpus;;;1.18;data-based;https://arxiv.org/abs/2310.20707;2
|
| 160 |
gigaword;;allenai/c4;;corpus;;;0.15;data-based;https://arxiv.org/abs/2310.20707;2
|
|
|
|
| 155 |
facebook/flores;;bigscience/mt0-xl;;model;;100.0;;data-based;https://aclanthology.org/2023.acl-long.891/;20
|
| 156 |
facebook/flores;;bigscience/mt0-xxl;;model;;100.0;;data-based;https://aclanthology.org/2023.acl-long.891/;20
|
| 157 |
facebook/flores;;bigscience/xP3;;corpus;;100.0;;data-based;https://aclanthology.org/2023.acl-long.891/;20
|
| 158 |
+
facebook/flores;;Claude 3 Opus;;model;;100.0;;model-based;https://arxiv.org/abs/2404.13813;29
|
| 159 |
|
| 160 |
gigaword;;EleutherAI/pile;;corpus;;;1.18;data-based;https://arxiv.org/abs/2310.20707;2
|
| 161 |
gigaword;;allenai/c4;;corpus;;;0.15;data-based;https://arxiv.org/abs/2310.20707;2
|