where 𝑃 𝜃 (𝑦|𝑥) is the probability, of an arbitrary classification algorithm, that a data point 𝑥 belongs to class 𝑦, and 𝑦 ̂1 and 𝑦 ̂2 are the most and second most probable predictions, respectively, of the algorithm. Previous works have shown better performance of Margin compared to other strategies .