pytorch en dataset:squad_v2 dataset:squad2 question-answering license:cc-by-4.0
---
language: en
tags:
- pytorch
- question-answering
datasets:
- squad_v2
- squad2
license: cc-by-4.0
metrics:
- squad_v2
- exact
- f1
widget:
- text: "By what main attribute are computational problems classified utilizing computational complexity theory?"
  context: "Computational complexity theory is a branch of the theory of computation in theoretical computer science that focuses on classifying computational problems according to their inherent difficulty, and relating those classes to each other. A computational problem is understood to be a task that is in principle amenable to being solved by a computer, which is equivalent to stating that the problem may be solved by mechanical application of mathematical steps, such as an algorithm."
---

# Performance
This ensemble was evaluated on [SQuAD 2.0](https://huggingface.co/datasets/squad_v2) with the following results:

```
{'HasAns_exact': 52.5472334682861,
 'HasAns_f1': 67.94939813758602,
 'HasAns_total': 5928,
 'NoAns_exact': 91.75777964676199,
 'NoAns_f1': 91.75777964676199,
 'NoAns_total': 5945,
 'best_exact': 72.16373283921503,
 'best_exact_thresh': 0.0,
 'best_f1': 79.85378860941708,
 'best_f1_thresh': 0.0,
 'exact': 72.1805777815211,
 'f1': 79.87063355172326,
 'total': 11873
 }
 ```