High dimensional online calibration in polynomial time
Not on the map. Why?
Abstract (arXiv)
In online (sequential) calibration, a forecaster predicts probability distributions over a finite outcome space [d] over a sequence of T days, with the goal of being calibrated. While asymptotically calibrated strategies are known to exist, they suffer from the curse of dimensionality: the best known algorithms require exp(d) days to achieve non-trivial calibration. In this work, we present the first asymptotically calibrated strategy that guarantees non-trivial calibration after a polynomial number of rounds. Specifically, for any desired accuracy ε > 0, our forecaster becomes ε-calibrated after T = dO(1/ε2) days. We complement this result with a lower bound, proving that at least T = dOmega(log(1/ε)) rounds are necessary to achieve ε-calibration. Our results resolve the open questions posed by [Abernethy-Mannor'11, Hazan-Kakade'12]. Our algorithm is inspired by recent breakthroughs in swap regret minimization [Peng-Rubinstein'24, Dagan et al.'24]. Despite its strong theoretical guarantees, the approach is remarkably simple and intuitive: it randomly selects among a set of sub-forecasters, each of which predicts the empirical outcome frequency over recent time windows.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 12 Apr 2025.
Builds on
22 of 40 references.
References · 22
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2020How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answeringcited by 445
- 2017On Fairness and Calibrationcited by 406
- 2021Revisiting the Calibration of Modern Neural Networkscited by 390
- 2023Calibrated Language Models Must Hallucinatecited by 115
- 2021Calibrating Predictions to Decisions: A Novel Approach to Multi-Class Calibrationcited by 79
- 2023U-Calibration: Forecasting for an Unknown Agentcited by 46
- 2023High-Dimensional Prediction for Sequential Decision Makingcited by 41
- 2020Stronger Calibration Lower Bounds via Sidesteppingcited by 38
- 2023Oracle Efficient Online Multicalibration and Omnipredictioncited by 37
- 2019Calibration, Entropy Rates, and Memory in Language Modelscited by 32
- 2023Fast swap regret minimization and applications to approximate correlated equilibriacited by 32
10 more
- 2023Calibrated Stackelberg Games: Learning Optimal Commitments Against Calibrated Agentscited by 25
- 2024Forecasting for Swap Regret for All Downstream Agentscited by 25
- 2022Smooth Calibration, Leaky Forecasts, Finite Recall, and Nash Dynamicscited by 22
- 2024On the Distance from Calibration in Sequential Predictioncited by 19
- 2024Breaking the T2/3 Barrier for Sequential Calibrationcited by 19
- 2022Calibrated Forecasts: The Minimax Proofcited by 17
- 2024On Computationally Efficient Multi-Class Calibrationcited by 16
- 2025Full Swap Regret and Discretized Calibrationcited by 15
- 2024Optimal Multiclass U-Calibration Error and Beyondcited by 13
- 2023From External to Swap Regret 2.0: An Efficient Reduction and Oblivious Adversary for Large Action Spacescited by 11
Built on by
Citing papers per year: 2025: 2; 2026: 11.
13 papers.
Sort:
- 2025High-Dimensional Calibration from Swap Regretcited by 13
- 2025Calibration through the Lens of Indistinguishabilitycited by 4
- 2026Simultaneous Blackwell Approachability and Applications to Multiclass Omnipredictioncited by 3
- 2026Swap Regret Minimization Through Response-Based Approachabilitycited by 2
- 2026Near-optimal Swap Regret Minimization for Convex Lossescited by 2
- 2026Testable and Actionable Calibration for Full Swap Regretcited by 2
- 2026Defensive Generationcited by 1
- 2026Computational and Statistical Hardness of Calibration Distancecited by 1
- 2026Algorithmic Collusion and the Complexity of Information-Value-Free Equilibriacited by 1
- 2026Efficient Opportunistic Approachabilitycited by 0
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Taskscited by 0
- 2026Improved Multi-Dimensional Forecasting for Swap Regretcited by 0
1 more
- 2026High-dimensional online calibration from harmonic weights6 Oct 2026
- 2026Algorithmic Collusion and the Complexity of Information-Value-Free Equilibria19 Sep 2026
- 2026Improved Multi-Dimensional Forecasting for Swap Regret28 Jun 2026
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Tasks21 May 2026
- 2026Testable and Actionable Calibration for Full Swap Regret18 May 2026
- 2026Computational and Statistical Hardness of Calibration Distance19 Mar 2026
- 2026Defensive Generation24 Feb 2026
- 2026Efficient Opportunistic Approachability24 Feb 2026
- 2026Simultaneous Blackwell Approachability and Applications to Multiclass Omniprediction19 Feb 2026
- 2026Near-optimal Swap Regret Minimization for Convex Losses9 Feb 2026
- 2026Swap Regret Minimization Through Response-Based Approachability5 Feb 2026
- 2025Calibration through the Lens of Indistinguishability2 Sep 2025
1 more
- 2025High-Dimensional Calibration from Swap Regret27 May 2025
- 2025High-Dimensional Calibration from Swap Regretcited by 13
- 2025Calibration through the Lens of Indistinguishabilitycited by 4
- 2026Simultaneous Blackwell Approachability and Applications to Multiclass Omnipredictioncited by 3
- 2026Swap Regret Minimization Through Response-Based Approachabilitycited by 2
- 2026Near-optimal Swap Regret Minimization for Convex Lossescited by 2
- 2026Testable and Actionable Calibration for Full Swap Regretcited by 2
- 2026Defensive Generationcited by 1
- 2026Computational and Statistical Hardness of Calibration Distancecited by 1
- 2026Algorithmic Collusion and the Complexity of Information-Value-Free Equilibriacited by 1
- 2026Efficient Opportunistic Approachabilitycited by 0
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Taskscited by 0
- 2026Improved Multi-Dimensional Forecasting for Swap Regretcited by 0
12 most cited of 13 All 13 (JSON)
- 2026High-dimensional online calibration from harmonic weights6 Oct 2026
- 2026Algorithmic Collusion and the Complexity of Information-Value-Free Equilibria19 Sep 2026
- 2026Improved Multi-Dimensional Forecasting for Swap Regret28 Jun 2026
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Tasks21 May 2026
- 2026Testable and Actionable Calibration for Full Swap Regret18 May 2026
- 2026Computational and Statistical Hardness of Calibration Distance19 Mar 2026
- 2026Defensive Generation24 Feb 2026
- 2026Efficient Opportunistic Approachability24 Feb 2026
- 2026Simultaneous Blackwell Approachability and Applications to Multiclass Omniprediction19 Feb 2026
- 2026Near-optimal Swap Regret Minimization for Convex Losses9 Feb 2026
- 2026Swap Regret Minimization Through Response-Based Approachability5 Feb 2026
- 2025Calibration through the Lens of Indistinguishability2 Sep 2025
12 newest of 13 All 13 (JSON)