Low-Degree Multicalibration
Not on the map. Why?
Abstract (arXiv)
Introduced as a notion of algorithmic fairness, multicalibration has proved to be a powerful and versatile concept with implications far beyond its original intent. This stringent notion -- that predictions be well-calibrated across a rich class of intersecting subpopulations -- provides its strong guarantees at a cost: the computational and sample complexity of learning multicalibrated predictors are high, and grow exponentially with the number of class labels. In contrast, the relaxed notion of multiaccuracy can be achieved more efficiently, yet many of the most desirable properties of multicalibration cannot be guaranteed assuming multiaccuracy alone. This tension raises a key question: Can we learn predictors with multicalibration-style guarantees at a cost commensurate with multiaccuracy? In this work, we define and initiate the study of Low-Degree Multicalibration. Low-Degree Multicalibration defines a hierarchy of increasingly-powerful multi-group fairness notions that spans multiaccuracy and the original formulation of multicalibration at the extremes. Our main technical contribution demonstrates that key properties of multicalibration, related to fairness and accuracy, actually manifest as low-degree properties. Importantly, we show that low-degree multicalibration can be significantly more efficient than full multicalibration. In the multi-class setting, the sample complexity to achieve low-degree multicalibration improves exponentially (in the number of classes) over full multicalibration. Our work presents compelling evidence that low-degree multicalibration represents a sweet spot, pairing computational and sample efficiency with strong fairness and accuracy guarantees.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). Builds on 27 of its 60 references that are in the map. First posted on arXiv 2 Mar 2022.
Builds on
27 of 60 references.
References · 27
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2017On Fairness and Calibrationcited by 406
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 381
- 2019Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibrationcited by 359
- 2018Multiaccuracy: Black-Box Post-Processing for Fairness in Classificationcited by 221
- 2014Preserving Statistical Validity in Adaptive Data Analysiscited by 102
- 2015Algorithmic Stability for Adaptive Data Analysiscited by 88
- 2019Distribution Calibration for Regressioncited by 88
- 2021Calibrating Predictions to Decisions: A Novel Approach to Multi-Class Calibrationcited by 79
- 2020Outcome Indistinguishabilitycited by 74
15 more
- 2021Omnipredictorscited by 71
- 2020Moment Multicalibration for Uncertainty Estimationcited by 63
- 2018Fairness Through Computationally-Bounded Awarenesscited by 55
- 2020Individual Calibration with Randomized Forecastingcited by 50
- 2021Online Multivalid Learning: Means, Moments, and Prediction Intervalscited by 48
- 2021Multi-group Agnostic PAC Learnabilitycited by 42
- 2019A New Analysis of Differential Privacy's Generalization Guaranteescited by 36
- 2019Advancing subgroup fairness via sleeping expertscited by 28
- 2021Simple and near-optimal algorithms for hidden stratification and multi-group learningcited by 26
- 2020Sample Complexity of Uniform Convergence for Multicalibrationcited by 24
- 2017Calibration for the (Computationally-Identifiable) Massescited by 23
- 2014Sum-of-squares proofs and the quest toward optimal algorithmscited by 12
- 2021Multicalibrated Partitions for Importance Weightscited by 10
- 2019Tracking and Improving Information in the Service of Fairnesscited by 8
- 2020Right Decisions from Wrong Predictions: A Mechanism Design Alternative to Individual Calibrationcited by 7
Built on by
Citing papers per year: 2022: 5; 2023: 12; 2024: 8; 2025: 16; 2026: 3.
44 papers.
Sort:
- 2024Large language model validity via enhanced conformal prediction methodscited by 91
- 2022Loss Minimization through the Lens of Outcome Indistinguishabilitycited by 61
- 2023Smooth ECE: Principled Reliability Diagrams via Kernel Smoothingcited by 59
- 2022A Unifying Theory of Distance from Calibrationcited by 51
- 2024Multicalibration for Confidence Scoring in LLMscited by 44
- 2023A Survey on Intersectional Fairness in Machine Learning: Notions, Mitigation, and Challengescited by 41
- 2023High-Dimensional Prediction for Sequential Decision Makingcited by 41
- 2023When Does Optimizing a Proper Loss Yield Calibration?cited by 35
- 2023Swap Agnostic Learning, or Characterizing Omniprediction via Multicalibrationcited by 31
- 2023A Unifying Perspective on Multi-Calibration: Game Dynamics for Multi-Objective Learningcited by 29
- 2023Loss Minimization Yields Multicalibration for Large Neural Networkscited by 19
- 2023HappyMap: A Generalized Multi-calibration Methodcited by 17
32 more
- 2024On Computationally Efficient Multi-Class Calibrationcited by 16
- 2024When is Multicalibration Post-Processing Necessary?cited by 16
- 2023From Pseudorandomness to Multi-Group Fairness and Backcited by 13
- 2024Fair Risk Control: A Generalized Framework for Calibrating Multi-group Fairness Riskscited by 13
- 2024Multi-group Uncertainty Quantification for Long-form Text Generationcited by 13
- 2023On the Richness of Calibrationcited by 9
- 2022Fair admission risk prediction with proportional multicalibrationcited by 8
- 2022Comparative Learning: A Sample Complexity Theory for Two Hypothesis Classescited by 8
- 2025How Global Calibration Strengthens Multiaccuracycited by 8
- 2025When does a predictor know its own loss?cited by 7
- 2025Networked Information Aggregation via Machine Learningcited by 7
- 2023The Scope of Multicalibration: Characterizing Multicalibration via Property Elicitationcited by 6
- 2025Discretization-free Multicalibration through Loss Minimization over Tree Ensemblescited by 6
- 2022Is your model predicting the past?cited by 5
- 2025Generalized and Unified Equivalences between Hardness and Pseudoentropycited by 5
- 2024Stability and Multigroup Fairness in Ranking with Uncertain Predictionscited by 4
- 2025Improved Bounds for Swap Multicalibration and Swap Omnipredictioncited by 4
- 2025Calibration through the Lens of Indistinguishabilitycited by 4
- 2024Diversity-aware clustering: Computational Complexity and Approximation Algorithmscited by 3
- 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Reviewcited by 3
- 2025Robust Decision Making with Partially Calibrated Forecastscited by 3
- 2025Efficient Calibration for Decision Makingcited by 3
- 2023Generative Models of Huge Objectscited by 2
- 2025Dimension-Free Decision Calibration for Nonlinear Loss Functionscited by 2
- 2025Supersimulatorscited by 2
- 2025Multicalibration Yields Better Matchingscited by 1
- 2026On the Convergence of Multicalibration Gradient Boostingcited by 1
- 2025Uniform convergence of the smooth calibration error and its relationship with functional gradientcited by 0
- 2025Auditability and the Landscape of Distance to Multicalibrationcited by 0
- 2025Scalable Utility-Aware Multiclass Calibrationcited by 0
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Taskscited by 0
- 2026Augmented Feature Boosting for Multicalibrationcited by 0
- 2026Augmented Feature Boosting for Multicalibration27 Sep 2026
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Tasks21 May 2026
- 2026On the Convergence of Multicalibration Gradient Boosting6 Feb 2026
- 2025Efficient Calibration for Decision Making17 Nov 2025
- 2025Multicalibration Yields Better Matchings14 Nov 2025
- 2025Scalable Utility-Aware Multiclass Calibration29 Oct 2025
- 2025Robust Decision Making with Partially Calibrated Forecasts27 Oct 2025
- 2025Supersimulators22 Sep 2025
- 2025Auditability and the Landscape of Distance to Multicalibration21 Sep 2025
- 2025Calibration through the Lens of Indistinguishability2 Sep 2025
- 2025Networked Information Aggregation via Machine Learning13 Jul 2025
- 2025Generalized and Unified Equivalences between Hardness and Pseudoentropy8 Jul 2025
32 more
- 2025Improved Bounds for Swap Multicalibration and Swap Omniprediction27 May 2025
- 2025Uniform convergence of the smooth calibration error and its relationship with functional gradient26 May 2025
- 2025Discretization-free Multicalibration through Loss Minimization over Tree Ensembles23 May 2025
- 2025Comparing Uncertainty Measurement and Mitigation Methods for Large Language Models: A Systematic Review25 Apr 2025
- 2025Dimension-Free Decision Calibration for Nonlinear Loss Functions22 Apr 2025
- 2025How Global Calibration Strengthens Multiaccuracy21 Apr 2025
- 2025When does a predictor know its own loss?27 Feb 2025
- 2024Multi-group Uncertainty Quantification for Long-form Text Generation25 Jul 2024
- 2024Large language model validity via enhanced conformal prediction methods14 Jun 2024
- 2024When is Multicalibration Post-Processing Necessary?10 Jun 2024
- 2024Fair Risk Control: A Generalized Framework for Calibrating Multi-group Fairness Risks3 May 2024
- 2024Multicalibration for Confidence Scoring in LLMs6 Apr 2024
- 2024Stability and Multigroup Fairness in Ranking with Uncertain Predictions14 Feb 2024
- 2024On Computationally Efficient Multi-Class Calibration12 Feb 2024
- 2024Diversity-aware clustering: Computational Complexity and Approximation Algorithms10 Jan 2024
- 2023High-Dimensional Prediction for Sequential Decision Making26 Oct 2023
- 2023Smooth ECE: Principled Reliability Diagrams via Kernel Smoothing21 Sep 2023
- 2023When Does Optimizing a Proper Loss Yield Calibration?30 May 2023
- 2023A Survey on Intersectional Fairness in Machine Learning: Notions, Mitigation, and Challenges11 May 2023
- 2023Loss Minimization Yields Multicalibration for Large Neural Networks19 Apr 2023
- 2023HappyMap: A Generalized Multi-calibration Method8 Mar 2023
- 2023Generative Models of Huge Objects24 Feb 2023
- 2023A Unifying Perspective on Multi-Calibration: Game Dynamics for Multi-Objective Learning21 Feb 2023
- 2023The Scope of Multicalibration: Characterizing Multicalibration via Property Elicitation16 Feb 2023
- 2023Swap Agnostic Learning, or Characterizing Omniprediction via Multicalibration13 Feb 2023
- 2023On the Richness of Calibration8 Feb 2023
- 2023From Pseudorandomness to Multi-Group Fairness and Back21 Jan 2023
- 2022A Unifying Theory of Distance from Calibration30 Nov 2022
- 2022Comparative Learning: A Sample Complexity Theory for Two Hypothesis Classes16 Nov 2022
- 2022Loss Minimization through the Lens of Outcome Indistinguishability16 Oct 2022
- 2022Fair admission risk prediction with proportional multicalibration29 Sep 2022
- 2022Is your model predicting the past?23 Jun 2022
- 2024Large language model validity via enhanced conformal prediction methodscited by 91
- 2022Loss Minimization through the Lens of Outcome Indistinguishabilitycited by 61
- 2023Smooth ECE: Principled Reliability Diagrams via Kernel Smoothingcited by 59
- 2022A Unifying Theory of Distance from Calibrationcited by 51
- 2024Multicalibration for Confidence Scoring in LLMscited by 44
- 2023A Survey on Intersectional Fairness in Machine Learning: Notions, Mitigation, and Challengescited by 41
- 2023High-Dimensional Prediction for Sequential Decision Makingcited by 41
- 2023When Does Optimizing a Proper Loss Yield Calibration?cited by 35
- 2023Swap Agnostic Learning, or Characterizing Omniprediction via Multicalibrationcited by 31
- 2023A Unifying Perspective on Multi-Calibration: Game Dynamics for Multi-Objective Learningcited by 29
- 2023Loss Minimization Yields Multicalibration for Large Neural Networkscited by 19
- 2023HappyMap: A Generalized Multi-calibration Methodcited by 17
12 most cited of 44 All 44 (JSON)
- 2026Augmented Feature Boosting for Multicalibration27 Sep 2026
- 2026Smoothed Elicitation Complexity for Approximate Gamma-calibration of Discrete Classification Tasks21 May 2026
- 2026On the Convergence of Multicalibration Gradient Boosting6 Feb 2026
- 2025Efficient Calibration for Decision Making17 Nov 2025
- 2025Multicalibration Yields Better Matchings14 Nov 2025
- 2025Scalable Utility-Aware Multiclass Calibration29 Oct 2025
- 2025Robust Decision Making with Partially Calibrated Forecasts27 Oct 2025
- 2025Supersimulators22 Sep 2025
- 2025Auditability and the Landscape of Distance to Multicalibration21 Sep 2025
- 2025Calibration through the Lens of Indistinguishability2 Sep 2025
- 2025Networked Information Aggregation via Machine Learning13 Jul 2025
- 2025Generalized and Unified Equivalences between Hardness and Pseudoentropy8 Jul 2025
12 newest of 44 All 44 (JSON)