A Benchmark for Strategic Auditee Gaming Under Continuous Compliance Monitoring
Not on the map. Why?
Abstract (arXiv)
Continuous post-deployment compliance audits, mandated by emerging regulations such as the EU AI Act and Digital Services Act, create a class of strategic gaming distinct from the one-shot input/output gaming studied in prior work. Regulated systems can delay outcome reporting, drift their reports within plausible noise envelopes, exploit longitudinal sample attrition, and cherry-pick among ambiguous metric definitions. We formalize continuous auditing as a T-round Stackelberg game between an auditor that commits to a temporal policy and an adaptive auditee, and identify a structural feature of any noise-aware static-auditor design: a cover regime in which coverage gaps and granularity gaps cannot be closed simultaneously. We make this formal as Observation 1 and show that two minimal extension policies, each derived from the observation, close the regime along orthogonal axes: a sample-size-aware static rule (Periodic-with-floor) closes the granularity-failure case, while a history-conditioned suspicion-escalation policy closes the coverage-failure case for the naive Drift strategy -- and neither closes both, exactly as the observation predicts; an audit-aware OffAuditDrift strategy that exploits Stackelberg commitment defeats both. To support empirical study we contribute a non-additive harm decomposition (welfare loss W, coverage loss C) that exposes how attrition shifts harm from the regulator-accountable surface to a regulator-invisible one; an initial library of five auditee strategies (Delay, Drift, Cherry-pick, Attrition, OffAuditDrift) and five auditor policies, calibrated to summary statistics from published audits of the DSA Transparency Database; and a reproducible simulator with a small, extensible Python interface.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
12 of 22 references.
References · 12
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
- 2020Performative Predictioncited by 318
- 2015Strategic Classificationcited by 256
- 2017Strategic Classification from Revealed Preferencescited by 126
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
- 2022Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governancecited by 67
- 2024The Elusive Pursuit of Reproducing PATE-GAN: Benchmarking, Auditing, Debuggingcited by 12
- 2023The DSA Transparency Database: Auditing Self-reported Moderation Actions by Social Mediacited by 10
- 2025The Accountability Paradox: How Platform API Restrictions Undermine AI Transparency Mandatescited by 7
- 2023Content Moderation on Social Media in the EU: Insights From the DSA Transparency Databasecited by 5
- 2014Audit Games with Multiple Defender Resourcescited by 4
- 2026Co-designing for Compliance: Multi-party Computation Protocols for Post-Market Fairness Monitoring in Algorithmic Hiringcited by 2
Built on by
Not cited yet.