---
abstract: 'We propose a novel loss function that dynamically re-scales the cross entropy based on prediction difficulty regarding a sample. Deep neural network architectures in image classification tasks struggle to disambiguate visually similar objects. Likewise, in human pose estimation symmetric body parts often confuse the network with assigning indiscriminative scores to them. This is due to the output prediction, in which only the highest confidence label is selected without taking into consideration a measure of uncertainty. In this work, we define the prediction difficulty as a relative property coming from the confidence score gap between positive and negative labels. More precisely, the proposed loss function penalizes the network to avoid the score of a false prediction being significant. To demonstrate the efficacy of our loss function, we evaluate it on two different domains: image classification and human pose estimation. We find improvements in both applications by achieving higher accuracy compared to the baseline methods.'
author:
- |
    Serim Ryou\
    California Institute of Technology\
- |
    Seong-Gyun Jeong\
    CODE42.ai\
- |
    Pietro Perona\
    California Institute of Technology\
bibliography:
- 'refs.bib'
title: 'Anchor Loss: Modulating Loss Scale based on Prediction Difficulty'
---

Conclusion
==========

In this paper, we presented anchor loss function which adaptively rescales the standard cross entropy function based on prediction difficulty. The network automatically evaluates the prediction difficulty by measuring the divergence among the network outputs regarding true positive and false positive predictions. The proposed loss function has shown strong empirical results on two different domains: image classification and human pose estimation. A simple drop-in replacement for standard cross entropy loss gives performance improvement. With a proper selection of designing the re-weighing scheme and anchor probability, the anchor loss can be applied to diverse machine learning and computer vision applications.

#### Acknowledgement {#acknowledgement .unnumbered}

We would like to thank Joseph Marino and Matteo Ruggero Ronchi for their valuable comments. This work was supported by funding from Disney Research.

{'source': 'arXiv_out/1909'}