mlsanityData to 7 Oct 2026

Coordinated Flaw Disclosure for AI: Beyond Security Vulnerabilities

arXiv 2402.07039 ↗First posted 10 Feb 2024cs.AI cs.CR cs.CYcited by 8

Not on the map. Why?

Abstract (arXiv)

Harm reporting in Artificial Intelligence (AI) currently lacks a structured process for disclosing and addressing algorithmic flaws, relying largely on an ad-hoc approach. This contrasts sharply with the well-established Coordinated Vulnerability Disclosure (CVD) ecosystem in software security. While global efforts to establish frameworks for AI transparency and collaboration are underway, the unique challenges presented by machine learning (ML) models demand a specialized approach. To address this gap, we propose implementing a Coordinated Flaw Disclosure (CFD) framework tailored to the complexities of ML and AI issues. This paper reviews the evolution of ML disclosure practices, from ad hoc reporting to emerging participatory auditing methods, and compares them with cybersecurity norms. Our framework introduces innovations such as extended model cards, dynamic scope expansion, an independent adjudication panel, and an automated verification process. We also outline a forthcoming real-world pilot of CFD. We argue that CFD could significantly enhance public trust in AI systems. By balancing organizational and community interests, CFD aims to improve AI accountability in a rapidly evolving technological landscape.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 14 of its 80 references that are in the map. First posted on arXiv 10 Feb 2024.

Builds on

14 of 80 references.

References · 14

  1. 2013Intriguing properties of neural networkscited by 5,114
  2. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  4. 2018Model Cards for Model Reportingcited by 1,068
  5. 2017Adversarial Patchcited by 514
  6. 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 415
  7. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
  8. 2022Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reductioncited by 137
  9. 2023Evaluating the Social Impact of Generative AI Systems in Systems and Societycited by 91
  10. 2022Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governancecited by 67
  11. 2020A Panda? No, It's a Sloth: Slowdown Attacks on Adaptive Multi-Exit Neural Network Inferencecited by 61
  12. 2021Image Cropping on Twitter: Fairness Metrics, their Limitations, and the Importance of Representation, Design, and Agencycited by 22
2 more
  1. 2018The Effects of JPEG and JPEG2000 Compression on Attacks using Adversarial Examplescited by 12
  2. 2023Bound by the Bounty: Collaboratively Shaping Evaluation Processes for Queer AI Harmscited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 5; 2026: 1.

8 papers.