mlsanityData to 14 Oct 2026

High dimensional online calibration in polynomial time

arXiv 2504.09096 ↗First posted 12 Apr 2025cs.LG cs.DS cs.GTcited by 13

Not on the map. Why?

Abstract (arXiv)

In online (sequential) calibration, a forecaster predicts probability distributions over a finite outcome space [d] over a sequence of T days, with the goal of being calibrated. While asymptotically calibrated strategies are known to exist, they suffer from the curse of dimensionality: the best known algorithms require exp(d) days to achieve non-trivial calibration. In this work, we present the first asymptotically calibrated strategy that guarantees non-trivial calibration after a polynomial number of rounds. Specifically, for any desired accuracy ε > 0, our forecaster becomes ε-calibrated after T = dO(1/ε2) days. We complement this result with a lower bound, proving that at least T = dOmega(log(1/ε)) rounds are necessary to achieve ε-calibration. Our results resolve the open questions posed by [Abernethy-Mannor'11, Hazan-Kakade'12]. Our algorithm is inspired by recent breakthroughs in swap regret minimization [Peng-Rubinstein'24, Dagan et al.'24]. Despite its strong theoretical guarantees, the approach is remarkably simple and intuitive: it randomly selects among a set of sub-forecasters, each of which predicts the empirical outcome frequency over recent time windows.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 12 Apr 2025.

Builds on

22 of 40 references.

References · 22

  1. 2017On Calibration of Modern Neural Networkscited by 4,960
  2. 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 445
  3. 2017On Fairness and Calibrationcited by 406
  4. 2021Revisiting the Calibration of Modern Neural Networkscited by 390
  5. 2023Calibrated Language Models Must Hallucinatecited by 115
  6. 2021Calibrating Predictions to Decisions: A Novel Approach to Multi-Class Calibrationcited by 79
  7. 2023U-Calibration: Forecasting for an Unknown Agentcited by 46
  8. 2023High-Dimensional Prediction for Sequential Decision Makingcited by 41
  9. 2020Stronger Calibration Lower Bounds via Sidesteppingcited by 38
  10. 2023Oracle Efficient Online Multicalibration and Omnipredictioncited by 37
  11. 2019Calibration, Entropy Rates, and Memory in Language Modelscited by 32
  12. 2023Fast swap regret minimization and applications to approximate correlated equilibriacited by 32
10 more
  1. 2023Calibrated Stackelberg Games: Learning Optimal Commitments Against Calibrated Agentscited by 25
  2. 2024Forecasting for Swap Regret for All Downstream Agentscited by 25
  3. 2022Smooth Calibration, Leaky Forecasts, Finite Recall, and Nash Dynamicscited by 22
  4. 2024On the Distance from Calibration in Sequential Predictioncited by 19
  5. 2024Breaking the T2/3 Barrier for Sequential Calibrationcited by 19
  6. 2022Calibrated Forecasts: The Minimax Proofcited by 17
  7. 2024On Computationally Efficient Multi-Class Calibrationcited by 16
  8. 2025Full Swap Regret and Discretized Calibrationcited by 15
  9. 2024Optimal Multiclass U-Calibration Error and Beyondcited by 13
  10. 2023From External to Swap Regret 2.0: An Efficient Reduction and Oblivious Adversary for Large Action Spacescited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 11.

13 papers.

Sort: