mlsanityData to 14 Oct 2026

Invertible Logits Transformation for Accuracy-Preserving Post-Hoc Uncertainty Calibration

arXiv 2608.10372 ↗First posted 11 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Post-hoc calibration aligns a classifier's predicted confidences with its empirical accuracy without retraining. An ideal calibrator should correct nonlinear miscalibration, scale gracefully to large label spaces, and preserve the original predictions; existing methods typically violate at least one of these properties---temperature scaling lacks expressivity, more flexible parametric alternatives introduce parameters that grow with the number of classes C, and other expressive methods do not preserve the rank ordering of class scores and may alter the predicted class. We propose Invertible Logits Transformation (InvLT), which applies a learned scalar MLP f:ℝ→ℝ element-wise to the pre-softmax logits. Sharing f across all logit dimensions makes the parameter count independent of C. Monotonicity of f---and hence preservation of the argmax prediction---is softly encouraged via a paired inverse network rather than enforced through the numerical integration required by prior monotone calibrators; this avoids their computational overhead while empirically preserving the original classification accuracy in every setting we evaluate. Across standard image classification benchmarks and a range of architectures, InvLT consistently outperforms a broad set of post-hoc baselines on standard calibration metrics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 11 Aug 2026.

Builds on

14 of 23 references.

References · 14

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2016Densely Connected Convolutional Networkscited by 6,720
  5. 2017On Calibration of Modern Neural Networkscited by 4,960
  6. 2016Wide Residual Networkscited by 3,070
  7. 2019Measuring Calibration in Deep Learningcited by 446
  8. 2021Revisiting the Calibration of Modern Neural Networkscited by 390
  9. 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 364
  10. 2020Mix-n-Match: Ensemble and Compositional Methods for Uncertainty Calibration in Deep Learningcited by 190
  11. 2020Calibration of Neural Networks using Splinescited by 97
  12. 2019Unconstrained Monotonic Neural Networkscited by 92
2 more
  1. 2020Intra Order-preserving Functions for Calibration of Multi-Class Neural Networkscited by 65
  2. 2021Parameterized Temperature Scaling for Boosting the Expressive Power in Post-Hoc Uncertainty Calibrationcited by 48

Built on by

Not cited yet.