Using BERT for the first time, what are the two columns of my test_results.tsv?
If you look at your output you will see that the two values in every row add up to 1. This means that the first value is the probability of the output having value 0 in your classification, and the second value the probability of the out having value 1. If you want to only have the 0/1 classification instead of the probabilities you can use a simply threshold for the probabilities (i.e. if value &lt; threshold then 0, else 1). The simplest way to set the threshold could be 0.5, but you could try changing threshold and see how the performance on your test set changes.