mlsanityData to 7 Oct 2026

Active Fairness Auditing

arXiv 2206.08450 ↗First posted 16 Jun 2022cs.LG cs.CY cs.DScited by 27

Not on the map. Why?

Abstract (arXiv)

The fast spreading adoption of machine learning (ML) by companies across industries poses significant regulatory challenges. One such challenge is scalability: how can regulatory bodies efficiently audit these ML models, ensuring that they are fair? In this paper, we initiate the study of query-based auditing algorithms that can estimate the demographic parity of ML models in a query-efficient manner. We propose an optimal deterministic algorithm, as well as a practical randomized, oracle-efficient algorithm with comparable guarantees. Furthermore, we make inroads into understanding the optimal query complexity of randomized active fairness estimation algorithms. Our first exploration of active fairness estimation aims to put AI governance on firmer theoretical foundations.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 8 of its 40 references that are in the map. First posted on arXiv 16 Jun 2022.

Builds on

8 of 40 references.

References · 8

  1. 2018A Reductions Approach to Fair Classificationcited by 585
  2. 2014Beyond Disagreement-based Agnostic Active Learningcited by 21
  3. 2015Efficient and Parsimonious Agnostic Active Learningcited by 17
  4. 2018Estimating Learnability in the Sublinear Data Regimecited by 10
  5. 2020VC Dimension and Distribution-Free Sample-Based Testingcited by 5
  6. 2017Active Tolerant Testingcited by 4
  7. 2013Auditing: Active Learning with Outcome-Dependent Query Costscited by 1
  8. 2020Estimating decision tree learnability with polylogarithmic sample complexitycited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 5; 2024: 7; 2025: 9; 2026: 5.

27 papers.

Sort:

By area:

  1. 2023Statistical Inference for Fairness Auditingcited by 19
  2. 2023Demystifying Local and Global Fairness Trade-offs in Federated Learning Using Partial Information Decompositioncited by 10
  3. 2022Can Querying for Bias Leak Protected Attributes? Achieving Privacy With Smooth Sensitivitycited by 8
  4. 2025Log Probability Tracking of LLM APIscited by 8
  5. 2023Toward Operationalizing Pipeline-aware ML Fairness: A Research Agenda for Developing Practical Guidelines and Toolscited by 7
  6. 2025A Generic Framework for Conformal Fairnesscited by 7
  7. 2024Active Fourier Auditor for Estimating Distributional Properties of ML Modelscited by 6
  8. 2025Robust ML Auditing using Prior Knowledgecited by 6
  9. 2024Under manipulations, are some AI models harder to audit?cited by 5
  10. 2023A Brief Tutorial on Sample Size Calculations for Fairness Auditscited by 4
  11. 2024A Unified View of Group Fairness Tradeoffs Using Partial Information Decompositioncited by 3
  12. 2024A Comprehensive Survey and Classification of Evaluation Criteria for Trustworthy Artificial Intelligencecited by 3
15 more
  1. 2023Cross-GAN Auditing: Unsupervised Identification of Attribute Level Similarities and Differences between Pretrained Generative Modelscited by 2
  2. 2024Fairness Auditing with Multi-Agent Collaborationcited by 2
  3. 2025Exposing the Illusion of Fairness: Auditing Vulnerabilities to Distributional Manipulation Attackscited by 2
  4. 2026Adaptive auditing of AI systems with anytime-valid guaranteescited by 2
  5. 2024Conformal Prediction: A Theoretical Note and Benchmarking Transductive Node Classification in Graphscited by 1
  6. 2025ExpProof : Operationalizing Explanations for Confidential Models with ZKPscited by 1
  7. 2026Auditing Fairness under Model Updates: Fundamental Complexity and Property-Preserving Updatescited by 1
  8. 2024Peer-induced Fairness: A Causal Approach for Algorithmic Fairness Auditingcited by 0
  9. 2025A Critical Review of Predominant Bias in Neural Networkscited by 0
  10. 2025Sublinear Algorithms for Wasserstein and Total Variation Distances: Applications to Fairness and Privacy Auditingcited by 0
  11. 2025The Fair Game: Auditing & Debiasing AI Algorithms Over Timecited by 0
  12. 2025Cost Efficient Fairness Audit Under Partial Feedbackcited by 0
  13. 2026The Evaluation Game: Beyond Static LLM Benchmarkingcited by 0
  14. 2026Fairness Auditing: Lower Bounds on Company Manipulationcited by 0
  15. 2026Tolerance-Based Fairness Auditing: Violation Certification and Sensitivity Screeningcited by 0