mlsanityData to 14 Oct 2026

High-Dimensional Calibration from Swap Regret

arXiv 2505.21460 ↗First posted 27 May 2025cs.LG cs.DS cs.GTcited by 13

Not on the map. Why?

Abstract (arXiv)

We study online calibration of multi-dimensional forecasts over an arbitrary convex set P subset ℝd relative to an arbitrary norm |·|. We connect this to external regret minimization for online linear optimization (OLO): if one can guarantee O(√ρ T) worst-case regret after T rounds when actions are drawn from P and losses from the dual |·|_* unit norm ball, then one can obtain ε-calibrated forecasts after T = exp(tilde O(ρ/ε2)) rounds. When P is the d-dimensional simplex and |·| is the ℓ1-norm, the O(√Tlog d) experts regret bound yields ε-calibrated forecasts after T = exp(tilde O(log d/ε2)) = dtilde O(1/ε2) rounds, recovering a recent result of Peng (2025). Interestingly, our algorithm obtains this guarantee without requiring access to any online linear optimization subroutine or knowledge of the optimal rate ρ -- in fact, our algorithm is identical for every setting of P and |·|. Instead, we show that the optimal regularizer for the above OLO problem can be used to upper bound the above calibration error by a swap regret, which we then minimize by running the recent TreeSwap algorithm (Dagan et al., 2024; Peng and Rubinstein, 2024) with Follow-The-Leader as a subroutine. The resulting algorithm is highly efficient and plays a distribution over simple averages of past observations in each round. Finally, we prove that any online calibration algorithm that guarantees ε T ℓ1-calibration error over the d-dimensional simplex requires T ≥ exp(poly(1/ε)) (assuming d ≥ poly(1/ε)). This strengthens the corresponding dOmega(log(1/ε)) lower bound of Peng (2025), and shows that an exponential dependence on 1/ε is necessary.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 20 of its 39 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

20 of 39 references.

References · 20

  1. 2017On Calibration of Modern Neural Networkscited by 4,960
  2. 2019Introduction to Online Convex Optimizationcited by 803
  3. 2022A Unifying Theory of Distance from Calibrationcited by 53
  4. 2020Individual Calibration with Randomized Forecastingcited by 50
  5. 2023U-Calibration: Forecasting for an Unknown Agentcited by 46
  6. 2023High-Dimensional Prediction for Sequential Decision Makingcited by 41
  7. 2020Stronger Calibration Lower Bounds via Sidesteppingcited by 38
  8. 2023Oracle Efficient Online Multicalibration and Omnipredictioncited by 37
  9. 2023Fast swap regret minimization and applications to approximate correlated equilibriacited by 32
  10. 2024Forecasting for Swap Regret for All Downstream Agentscited by 25
  11. 2022Smooth Calibration, Leaky Forecasts, Finite Recall, and Nash Dynamicscited by 22
  12. 2024On the Distance from Calibration in Sequential Predictioncited by 19
8 more
  1. 2024Breaking the T2/3 Barrier for Sequential Calibrationcited by 19
  2. 2022Calibrated Forecasts: The Minimax Proofcited by 17
  3. 2025Full Swap Regret and Discretized Calibrationcited by 15
  4. 2024Optimal Multiclass U-Calibration Error and Beyondcited by 13
  5. 2025High dimensional online calibration in polynomial timecited by 13
  6. 2025Simultaneous Swap Regret Minimization via KL-Calibrationcited by 11
  7. 2024A Lower Bound on Swap Regret in Extensive-Form Gamescited by 8
  8. 2024Computing Optimal Regularizers for Online Linear Optimizationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 11.

13 papers.

Sort: