Revisiting Reweighted Risk for Calibration: AURC, Focal, and Inverse Focal Loss
Not on the map. Why?
Abstract (arXiv)
Several variants of reweighted risk functionals, such as focal loss, inverse focal loss, and the Area Under the Risk Coverage Curve (AURC), have been proposed for improving model calibration; yet their theoretical connections to calibration errors remain under-explored. In this paper, we revisit a broad class of weighted risk functions and find a principled connection between calibration error and selective classification. We show that minimizing calibration error is closely linked to the selective classification paradigm and demonstrate that optimizing selective risk in low confidence regions naturally improves calibration. Our proposed loss shares a similar reweighting strategy with dual focal loss but offers greater flexibility through the choice of confidence score functions (CSFs). Furthermore, our approach utilizes a bin-based cumulative distribution function (CDF) approximation, enabling efficient gradient-based optimization with O(nM) complexity for n samples and M bins. Empirical evaluations demonstrate that our method achieves competitive calibration performance across a range of datasets and model architectures.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 49 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
34 of 49 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023GPT-4 Technical Reportcited by 18,396
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2016Wide Residual Networkscited by 3,070
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 364
- 2020Calibrating Deep Neural Networks using Focal Losscited by 357
22 more
- 2019Verified Uncertainty Calibrationcited by 309
- 2020Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Taskscited by 138
- 2020Improving model calibration with accuracy versus uncertainty optimizationcited by 123
- 2018Bias-Reduced Uncertainty Estimation for Deep Neural Classifierscited by 113
- 2020Local Temperature Scaling for Probability Calibrationcited by 95
- 2021Soft Calibration Objectives for Neural Networkscited by 92
- 2022Better Uncertainty Calibration via Proper Scores for Classification and Beyondcited by 65
- 2019Non-Parametric Calibration for Classificationcited by 57
- 2022A Consistent and Differentiable Lp Canonical Calibration Error Estimatorcited by 47
- 2021Top-label calibration and multiclass-to-binary reductionscited by 46
- 2023What Can We Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifierscited by 35
- 2021Meta-Cal: Well-controlled Post-hoc Calibration by Rankingcited by 33
- 2023Dual Focal Loss for Calibrationcited by 33
- 2022AdaFocal: Calibration-aware Adaptive Focal Losscited by 32
- 2021Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Errorcited by 29
- 2020On Focal Loss for Class-Posterior Probability Estimation: A Theoretical Perspectivecited by 21
- 2024A Novel Characterization of the Population Area Under the Risk Coverage Curve (AURC) and Rates of Finite Sample Estimatorscited by 15
- 2021What classifiers know what they don't?cited by 6
- 2022Class-wise and reduced calibration methodscited by 4
- 2024Optimizing Calibration by Gaining Aware of Prediction Correctnesscited by 4
- 2024Improving Calibration by Relating Focal Loss, Temperature Scaling, and Propernesscited by 4
- 2024Accuracy-Preserving Calibration via Statistical Modeling on Probability Simplexcited by 3
Built on by
Not cited yet.