High-Dimensional Calibration from Swap Regret
Not on the map. Why?
Abstract (arXiv)
We study online calibration of multi-dimensional forecasts over an arbitrary convex set P subset ℝd relative to an arbitrary norm |·|. We connect this to external regret minimization for online linear optimization (OLO): if one can guarantee O(√ρ T) worst-case regret after T rounds when actions are drawn from P and losses from the dual |·|_* unit norm ball, then one can obtain ε-calibrated forecasts after T = exp(tilde O(ρ/ε2)) rounds. When P is the d-dimensional simplex and |·| is the ℓ1-norm, the O(√Tlog d) experts regret bound yields ε-calibrated forecasts after T = exp(tilde O(log d/ε2)) = dtilde O(1/ε2) rounds, recovering a recent result of Peng (2025). Interestingly, our algorithm obtains this guarantee without requiring access to any online linear optimization subroutine or knowledge of the optimal rate ρ -- in fact, our algorithm is identical for every setting of P and |·|. Instead, we show that the optimal regularizer for the above OLO problem can be used to upper bound the above calibration error by a swap regret, which we then minimize by running the recent TreeSwap algorithm (Dagan et al., 2024; Peng and Rubinstein, 2024) with Follow-The-Leader as a subroutine. The resulting algorithm is highly efficient and plays a distribution over simple averages of past observations in each round. Finally, we prove that any online calibration algorithm that guarantees ε T ℓ1-calibration error over the d-dimensional simplex requires T ≥ exp(poly(1/ε)) (assuming d ≥ poly(1/ε)). This strengthens the corresponding dOmega(log(1/ε)) lower bound of Peng (2025), and shows that an exponential dependence on 1/ε is necessary.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
20 of 39 references.
References · 20
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2019Introduction to Online Convex Optimizationcited by 803
- 2022A Unifying Theory of Distance from Calibrationcited by 53
- 2020Individual Calibration with Randomized Forecastingcited by 50
- 2023U-Calibration: Forecasting for an Unknown Agentcited by 46
- 2023High-Dimensional Prediction for Sequential Decision Makingcited by 41
- 2020Stronger Calibration Lower Bounds via Sidesteppingcited by 38
- 2023Oracle Efficient Online Multicalibration and Omnipredictioncited by 37
- 2023Fast swap regret minimization and applications to approximate correlated equilibriacited by 32
- 2024Forecasting for Swap Regret for All Downstream Agentscited by 25
- 2022Smooth Calibration, Leaky Forecasts, Finite Recall, and Nash Dynamicscited by 22
- 2024On the Distance from Calibration in Sequential Predictioncited by 19
8 more
- 2024Breaking the T2/3 Barrier for Sequential Calibrationcited by 19
- 2022Calibrated Forecasts: The Minimax Proofcited by 17
- 2025Full Swap Regret and Discretized Calibrationcited by 15
- 2024Optimal Multiclass U-Calibration Error and Beyondcited by 13
- 2025High dimensional online calibration in polynomial timecited by 13
- 2025Simultaneous Swap Regret Minimization via KL-Calibrationcited by 11
- 2024A Lower Bound on Swap Regret in Extensive-Form Gamescited by 8
- 2024Computing Optimal Regularizers for Online Linear Optimizationcited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 11.
13 papers.
Sort:
- 2025Calibration through the Lens of Indistinguishabilitycited by 4
- 2025Proximal Regret and Proximal Correlated Equilibria: A New Tractable Solution Concept for Online Learning and Gamescited by 3
- 2026Simultaneous Blackwell Approachability and Applications to Multiclass Omnipredictioncited by 3
- 2026Swap Regret Minimization Through Response-Based Approachabilitycited by 2
- 2026Near-optimal Swap Regret Minimization for Convex Lossescited by 2
- 2026Testable and Actionable Calibration for Full Swap Regretcited by 2
- 2026Defensive Generationcited by 1
- 2026Computational and Statistical Hardness of Calibration Distancecited by 1
- 2026Algorithmic Collusion and the Complexity of Information-Value-Free Equilibriacited by 1
- 2026Efficient Opportunistic Approachabilitycited by 0
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Taskscited by 0
- 2026Improved Multi-Dimensional Forecasting for Swap Regretcited by 0
1 more
- 2026High-dimensional online calibration from harmonic weights6 Oct 2026
- 2026Algorithmic Collusion and the Complexity of Information-Value-Free Equilibria19 Sep 2026
- 2026Improved Multi-Dimensional Forecasting for Swap Regret28 Jun 2026
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Tasks21 May 2026
- 2026Testable and Actionable Calibration for Full Swap Regret18 May 2026
- 2026Computational and Statistical Hardness of Calibration Distance19 Mar 2026
- 2026Defensive Generation24 Feb 2026
- 2026Efficient Opportunistic Approachability24 Feb 2026
- 2026Simultaneous Blackwell Approachability and Applications to Multiclass Omniprediction19 Feb 2026
- 2026Near-optimal Swap Regret Minimization for Convex Losses9 Feb 2026
- 2026Swap Regret Minimization Through Response-Based Approachability5 Feb 2026
- 2025Proximal Regret and Proximal Correlated Equilibria: A New Tractable Solution Concept for Online Learning and Games3 Nov 2025
1 more
- 2025Calibration through the Lens of Indistinguishability2 Sep 2025
- 2025Calibration through the Lens of Indistinguishabilitycited by 4
- 2025Proximal Regret and Proximal Correlated Equilibria: A New Tractable Solution Concept for Online Learning and Gamescited by 3
- 2026Simultaneous Blackwell Approachability and Applications to Multiclass Omnipredictioncited by 3
- 2026Swap Regret Minimization Through Response-Based Approachabilitycited by 2
- 2026Near-optimal Swap Regret Minimization for Convex Lossescited by 2
- 2026Testable and Actionable Calibration for Full Swap Regretcited by 2
- 2026Defensive Generationcited by 1
- 2026Computational and Statistical Hardness of Calibration Distancecited by 1
- 2026Algorithmic Collusion and the Complexity of Information-Value-Free Equilibriacited by 1
- 2026Efficient Opportunistic Approachabilitycited by 0
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Taskscited by 0
- 2026Improved Multi-Dimensional Forecasting for Swap Regretcited by 0
12 most cited of 13 All 13 (JSON)
- 2026High-dimensional online calibration from harmonic weights6 Oct 2026
- 2026Algorithmic Collusion and the Complexity of Information-Value-Free Equilibria19 Sep 2026
- 2026Improved Multi-Dimensional Forecasting for Swap Regret28 Jun 2026
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Tasks21 May 2026
- 2026Testable and Actionable Calibration for Full Swap Regret18 May 2026
- 2026Computational and Statistical Hardness of Calibration Distance19 Mar 2026
- 2026Defensive Generation24 Feb 2026
- 2026Efficient Opportunistic Approachability24 Feb 2026
- 2026Simultaneous Blackwell Approachability and Applications to Multiclass Omniprediction19 Feb 2026
- 2026Near-optimal Swap Regret Minimization for Convex Losses9 Feb 2026
- 2026Swap Regret Minimization Through Response-Based Approachability5 Feb 2026
- 2025Proximal Regret and Proximal Correlated Equilibria: A New Tractable Solution Concept for Online Learning and Games3 Nov 2025
12 newest of 13 All 13 (JSON)