mlsanityData to 14 Oct 2026

Ordinal-Aware Calibration for Ordinal Classification

arXiv 2410.15658 ↗First posted 21 Oct 2024cs.LG cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Deep neural networks frequently produce overconfident, miscalibrated predictions. In ordinal classification, predictions must also adhere to a unimodal and order-consistent structure, a requirement that has dominated prior work while overlooking calibration. We formalize this joint challenge as ordinal calibration for the first time and propose the Ordinal loss for Calibration and Unimodality (ORCU). Unlike incremental modular combinations, ORCU provides a concise, principled unification of distance-aware soft encoding and an ordinal-aware log-barrier extension on adjacent logit gaps. This coupling is theoretically synergetic: soft-encoded targets pre-condition the optimization landscape by providing a finite, full-support ordinal anchor for well-posed refinement, while the log-barrier extension preserves non-vanishing adjacent-gap gradients in the unimodality-feasible interior. This enables the log-barrier to refine confidence without disrupting the ordinal geometry. ORCU requires no architectural changes or post-hoc calibration. Across four ordinal benchmarks, it achieves state-of-the-art calibration without compromising accuracy. We establish a new reliability standard by providing a reproducible benchmark over 10 specialized and general-purpose loss functions. Our code is available at https://github.com/labhai/ORCU.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 65 references that are in the map. First posted on arXiv 21 Oct 2024.

Builds on

32 of 65 references.

References · 32

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  4. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  5. 2017On Calibration of Modern Neural Networkscited by 4,960
  6. 2018Albumentations: fast and flexible image augmentationscited by 560
  7. 2019Measuring Calibration in Deep Learningcited by 446
  8. 2021Revisiting the Calibration of Modern Neural Networkscited by 390
  9. 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 364
  10. 2020Calibrating Deep Neural Networks using Focal Losscited by 357
  11. 2019Rank consistent ordinal regression for neural networks with application to age estimationcited by 133
  12. 2020Confidence-Aware Learning for Deep Neural Networkscited by 113
20 more
  1. 2020Mitigating Bias in Calibration Error Estimationcited by 101
  2. 2021The Devil is in the Margin: Margin-based Label Smoothing for Network Calibrationcited by 91
  3. 2021Classifier Calibration: A survey on how to assess and improve predicted class probabilitiescited by 73
  4. 2020Post-hoc Uncertainty Calibration for Domain Drift Scenarioscited by 61
  5. 2021Deep Neural Networks for Rank-Consistent Ordinal Regression Based On Conditional Probabilitiescited by 59
  6. 2021Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regressioncited by 58
  7. 2022A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibrationcited by 49
  8. 2021Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibrationcited by 48
  9. 2023Improving Deep Regression with Ordinal Entropycited by 45
  10. 2019BridgeNet: A Continuity-Aware Probabilistic Network for Age Estimationcited by 39
  11. 2019Constrained Deep Networks: Lagrangian Optimization via Log-Barrier Extensionscited by 30
  12. 2017Label Distribution Learning Forestscited by 25
  13. 2022Unimodal-Concentrated Loss: Fully Adaptive Label Distribution Learning for Ordinal Regressioncited by 23
  14. 2023A Call to Reflect on Evaluation Practices for Age Estimation: Comparative Analysis of the State-of-the-Art and a Unified Benchmarkcited by 19
  15. 2015An Image is Worth More than a Thousand Favorites: Surfacing the Hidden Beauty of Flickr Picturescited by 18
  16. 2022Class Distance Weighted Cross-Entropy Loss for Ulcerative Colitis Severity Estimationcited by 17
  17. 2023ACLS: Adaptive and Conditional Label Smoothing for Network Calibrationcited by 15
  18. 2023Is Grad-CAM Explainable in Medical Images?cited by 10
  19. 2023Unimodal Distributions for Ordinal Regressioncited by 9
  20. 2024Interpret Your Decision: Logical Reasoning Regularization for Generalization in Visual Classificationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.