mlsanityData to 7 Oct 2026

Low-Degree Multicalibration

arXiv 2203.01255 ↗First posted 2 Mar 2022cs.LG cs.CCcited by 44

Not on the map. Why?

Abstract (arXiv)

Introduced as a notion of algorithmic fairness, multicalibration has proved to be a powerful and versatile concept with implications far beyond its original intent. This stringent notion -- that predictions be well-calibrated across a rich class of intersecting subpopulations -- provides its strong guarantees at a cost: the computational and sample complexity of learning multicalibrated predictors are high, and grow exponentially with the number of class labels. In contrast, the relaxed notion of multiaccuracy can be achieved more efficiently, yet many of the most desirable properties of multicalibration cannot be guaranteed assuming multiaccuracy alone. This tension raises a key question: Can we learn predictors with multicalibration-style guarantees at a cost commensurate with multiaccuracy? In this work, we define and initiate the study of Low-Degree Multicalibration. Low-Degree Multicalibration defines a hierarchy of increasingly-powerful multi-group fairness notions that spans multiaccuracy and the original formulation of multicalibration at the extremes. Our main technical contribution demonstrates that key properties of multicalibration, related to fairness and accuracy, actually manifest as low-degree properties. Importantly, we show that low-degree multicalibration can be significantly more efficient than full multicalibration. In the multi-class setting, the sample complexity to achieve low-degree multicalibration improves exponentially (in the number of classes) over full multicalibration. Our work presents compelling evidence that low-degree multicalibration represents a sweet spot, pairing computational and sample efficiency with strong fairness and accuracy guarantees.

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Builds on 27 of its 60 references that are in the map. First posted on arXiv 2 Mar 2022.

Builds on

27 of 60 references.

References · 27

  1. 2017On Calibration of Modern Neural Networkscited by 4,860
  2. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  3. 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
  4. 2017On Fairness and Calibrationcited by 406
  5. 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
  6. 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 359
  7. 2018Multiaccuracy: Black-Box Post-Processing for Fairness in Classificationcited by 221
  8. 2014Preserving Statistical Validity in Adaptive Data Analysiscited by 102
  9. 2015Algorithmic Stability for Adaptive Data Analysiscited by 88
  10. 2019Distribution Calibration for Regressioncited by 88
  11. 2021Calibrating Predictions to Decisions: A Novel Approach to Multi-Class Calibrationcited by 79
  12. 2020Outcome Indistinguishabilitycited by 74
15 more
  1. 2021Omnipredictorscited by 71
  2. 2020Moment Multicalibration for Uncertainty Estimationcited by 63
  3. 2018Fairness Through Computationally-Bounded Awarenesscited by 55
  4. 2020Individual Calibration with Randomized Forecastingcited by 50
  5. 2021Online Multivalid Learning: Means, Moments, and Prediction Intervalscited by 48
  6. 2021Multi-group Agnostic PAC Learnabilitycited by 42
  7. 2019A New Analysis of Differential Privacy's Generalization Guaranteescited by 36
  8. 2019Advancing subgroup fairness via sleeping expertscited by 28
  9. 2021Simple and near-optimal algorithms for hidden stratification and multi-group learningcited by 26
  10. 2020Sample Complexity of Uniform Convergence for Multicalibrationcited by 24
  11. 2017Calibration for the (Computationally-Identifiable) Massescited by 23
  12. 2014Sum-of-squares proofs and the quest toward optimal algorithmscited by 12
  13. 2021Multicalibrated Partitions for Importance Weightscited by 10
  14. 2019Tracking and Improving Information in the Service of Fairnesscited by 8
  15. 2020Right Decisions from Wrong Predictions: A Mechanism Design Alternative to Individual Calibrationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 12; 2024: 8; 2025: 16; 2026: 3.

44 papers.

Sort:

  1. 2024Large language model validity via enhanced conformal prediction methodscited by 91
  2. 2022Loss Minimization through the Lens of Outcome Indistinguishabilitycited by 61
  3. 2023Smooth ECE: Principled Reliability Diagrams via Kernel Smoothingcited by 59
  4. 2022A Unifying Theory of Distance from Calibrationcited by 51
  5. 2024Multicalibration for Confidence Scoring in LLMscited by 44
  6. 2023A Survey on Intersectional Fairness in Machine Learning: Notions, Mitigation, and Challengescited by 41
  7. 2023High-Dimensional Prediction for Sequential Decision Makingcited by 41
  8. 2023When Does Optimizing a Proper Loss Yield Calibration?cited by 35
  9. 2023Swap Agnostic Learning, or Characterizing Omniprediction via Multicalibrationcited by 31
  10. 2023A Unifying Perspective on Multi-Calibration: Game Dynamics for Multi-Objective Learningcited by 29
  11. 2023Loss Minimization Yields Multicalibration for Large Neural Networkscited by 19
  12. 2023HappyMap: A Generalized Multi-calibration Methodcited by 17
32 more
  1. 2024On Computationally Efficient Multi-Class Calibrationcited by 16
  2. 2024When is Multicalibration Post-Processing Necessary?cited by 16
  3. 2023From Pseudorandomness to Multi-Group Fairness and Backcited by 13
  4. 2024Fair Risk Control: A Generalized Framework for Calibrating Multi-group Fairness Riskscited by 13
  5. 2024Multi-group Uncertainty Quantification for Long-form Text Generationcited by 13
  6. 2023On the Richness of Calibrationcited by 9
  7. 2022Fair admission risk prediction with proportional multicalibrationcited by 8
  8. 2022Comparative Learning: A Sample Complexity Theory for Two Hypothesis Classescited by 8
  9. 2025How Global Calibration Strengthens Multiaccuracycited by 8
  10. 2025When does a predictor know its own loss?cited by 7
  11. 2025Networked Information Aggregation via Machine Learningcited by 7
  12. 2023The Scope of Multicalibration: Characterizing Multicalibration via Property Elicitationcited by 6
  13. 2025Discretization-free Multicalibration through Loss Minimization over Tree Ensemblescited by 6
  14. 2022Is your model predicting the past?cited by 5
  15. 2025Generalized and Unified Equivalences between Hardness and Pseudoentropycited by 5
  16. 2024Stability and Multigroup Fairness in Ranking with Uncertain Predictionscited by 4
  17. 2025Improved Bounds for Swap Multicalibration and Swap Omnipredictioncited by 4
  18. 2025Calibration through the Lens of Indistinguishabilitycited by 4
  19. 2024Diversity-aware clustering: Computational Complexity and Approximation Algorithmscited by 3
  20. 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Reviewcited by 3
  21. 2025Robust Decision Making with Partially Calibrated Forecastscited by 3
  22. 2025Efficient Calibration for Decision Makingcited by 3
  23. 2023Generative Models of Huge Objectscited by 2
  24. 2025Dimension-Free Decision Calibration for Nonlinear Loss Functionscited by 2
  25. 2025Supersimulatorscited by 2
  26. 2025Multicalibration Yields Better Matchingscited by 1
  27. 2026On the Convergence of Multicalibration Gradient Boostingcited by 1
  28. 2025Uniform convergence of the smooth calibration error and its relationship with functional gradientcited by 0
  29. 2025Auditability and the Landscape of Distance to Multicalibrationcited by 0
  30. 2025Scalable Utility-Aware Multiclass Calibrationcited by 0
  31. 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Taskscited by 0
  32. 2026Augmented Feature Boosting for Multicalibrationcited by 0