mlsanityData to 7 Oct 2026

A Benchmark for Strategic Auditee Gaming Under Continuous Compliance Monitoring

arXiv 2605.06340 ↗First posted 7 May 2026cs.CY cs.GT cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Continuous post-deployment compliance audits, mandated by emerging regulations such as the EU AI Act and Digital Services Act, create a class of strategic gaming distinct from the one-shot input/output gaming studied in prior work. Regulated systems can delay outcome reporting, drift their reports within plausible noise envelopes, exploit longitudinal sample attrition, and cherry-pick among ambiguous metric definitions. We formalize continuous auditing as a T-round Stackelberg game between an auditor that commits to a temporal policy and an adaptive auditee, and identify a structural feature of any noise-aware static-auditor design: a cover regime in which coverage gaps and granularity gaps cannot be closed simultaneously. We make this formal as Observation 1 and show that two minimal extension policies, each derived from the observation, close the regime along orthogonal axes: a sample-size-aware static rule (Periodic-with-floor) closes the granularity-failure case, while a history-conditioned suspicion-escalation policy closes the coverage-failure case for the naive Drift strategy -- and neither closes both, exactly as the observation predicts; an audit-aware OffAuditDrift strategy that exploits Stackelberg commitment defeats both. To support empirical study we contribute a non-additive harm decomposition (welfare loss W, coverage loss C) that exposes how attrition shifts harm from the regulator-accountable surface to a regulator-invisible one; an initial library of five auditee strategies (Delay, Drift, Cherry-pick, Attrition, OffAuditDrift) and five auditor policies, calibrated to summary statistics from published audits of the DSA Transparency Database; and a reproducible simulator with a small, extensible Python interface.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

12 of 22 references.

References · 12

  1. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  2. 2020Performative Predictioncited by 318
  3. 2015Strategic Classificationcited by 256
  4. 2017Strategic Classification from Revealed Preferencescited by 126
  5. 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
  6. 2022Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governancecited by 67
  7. 2024The Elusive Pursuit of Reproducing PATE-GAN: Benchmarking, Auditing, Debuggingcited by 12
  8. 2023The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social Mediacited by 10
  9. 2025The Accountability Paradox: How Platform API Restrictions Undermine AI Transparency Mandatescited by 7
  10. 2023Content Moderation on Social Media in the EU: Insights From the DSA Transparency Databasecited by 5
  11. 2014Audit Games with Multiple Defender Resourcescited by 4
  12. 2026Co-designing for Compliance: Multi-party Computation Protocols for Post-Market Fairness Monitoring in Algorithmic Hiringcited by 2

Built on by

Not cited yet.