Coordinated Flaw Disclosure for AI: Beyond Security Vulnerabilities
Not on the map. Why?
Abstract (arXiv)
Harm reporting in Artificial Intelligence (AI) currently lacks a structured process for disclosing and addressing algorithmic flaws, relying largely on an ad-hoc approach. This contrasts sharply with the well-established Coordinated Vulnerability Disclosure (CVD) ecosystem in software security. While global efforts to establish frameworks for AI transparency and collaboration are underway, the unique challenges presented by machine learning (ML) models demand a specialized approach. To address this gap, we propose implementing a Coordinated Flaw Disclosure (CFD) framework tailored to the complexities of ML and AI issues. This paper reviews the evolution of ML disclosure practices, from ad hoc reporting to emerging participatory auditing methods, and compares them with cybersecurity norms. Our framework introduces innovations such as extended model cards, dynamic scope expansion, an independent adjudication panel, and an automated verification process. We also outline a forthcoming real-world pilot of CFD. We argue that CFD could significantly enhance public trust in AI systems. By balancing organizational and community interests, CFD aims to improve AI accountability in a rapidly evolving technological landscape.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 14 of its 80 references that are in the map. First posted on arXiv 10 Feb 2024.
Builds on
14 of 80 references.
References · 14
- 2013Intriguing properties of neural networkscited by 5,114
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2018Model Cards for Model Reportingcited by 1,068
- 2017Adversarial Patchcited by 514
- 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 415
- 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
- 2022Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reductioncited by 137
- 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 91
- 2022Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governancecited by 67
- 2020A Panda? No, It's a Sloth: Slowdown Attacks on Adaptive Multi-Exit Neural Network Inferencecited by 61
- 2021Image Cropping on Twitter: Fairness Metrics, their Limitations, and the Importance of Representation, Design, and Agencycited by 22
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 1.
8 papers.
- 2024A Safe Harbor for AI Evaluation and Red Teamingcited by 46
- 2025In-House Evaluation Is Not Enough: Towards Robust Third-Party Flaw Disclosure for General-Purpose AIcited by 7
- 2024To Err is AI : A Case Study Informing LLM Flaw Reporting Practicescited by 5
- 2025Who Evaluates AI's Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluationscited by 4
- 2025The Pitfalls of "Security by Obscurity" And What They Mean for Transparent AIcited by 2
- 2025Malicious and Unintentional Disclosure Risks in Large Language Models for Code Generationcited by 0
- 2025The Current State of AI Bias Bounties: An Overview of Existing Programmes and Researchcited by 0
- 2026FLARE-AI: Flaw Reporting for AIcited by 0
- 2026FLARE-AI: Flaw Reporting for AI30 Jun 2026
- 2025Who Evaluates AI's Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations6 Nov 2025
- 2025The Current State of AI Bias Bounties: An Overview of Existing Programmes and Research2 Oct 2025
- 2025Malicious and Unintentional Disclosure Risks in Large Language Models for Code Generation27 Mar 2025
- 2025In-House Evaluation Is Not Enough: Towards Robust Third-Party Flaw Disclosure for General-Purpose AI21 Mar 2025
- 2025The Pitfalls of "Security by Obscurity" And What They Mean for Transparent AI30 Jan 2025
- 2024To Err is AI : A Case Study Informing LLM Flaw Reporting Practices15 Oct 2024
- 2024A Safe Harbor for AI Evaluation and Red Teaming7 Mar 2024