mlsanityData to 14 Oct 2026

A Different Approach to AI Safety: Proceedings from the Columbia Convening on Openness in Artificial Intelligence and AI Safety

arXiv 2506.22183 ↗First posted 27 Jun 2025cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

The rapid rise of open-weight and open-source foundation models is intensifying the obligation and reshaping the opportunity to make AI systems safe. This paper reports outcomes from the Columbia Convening on AI Openness and Safety (San Francisco, 19 Nov 2024) and its six-week preparatory programme involving more than forty-five researchers, engineers, and policy leaders from academia, industry, civil society, and government. Using a participatory, solutions-oriented process, the working groups produced (i) a research agenda at the intersection of safety and open source AI; (ii) a mapping of existing and needed technical interventions and open source tools to safely and responsibly deploy open foundation models across the AI development workflow; and (iii) a mapping of the content safety filter ecosystem with a proposed roadmap for future research and development. We find that openness -- understood as transparent weights, interoperable tooling, and public governance -- can enhance safety by enabling independent scrutiny, decentralized mitigation, and culturally plural oversight. However, significant gaps persist: scarce multimodal and multilingual benchmarks, limited defenses against prompt-injection and compositional attacks in agentic systems, and insufficient participatory mechanisms for communities most affected by AI harms. The paper concludes with a roadmap of five priority research directions, emphasizing participatory inputs, future-proof content filters, ecosystem-wide safety infrastructure, rigorous agentic safeguards, and expanded harm taxonomies. These recommendations informed the February 2025 French AI Action Summit and lay groundwork for an open, plural, and accountable AI safety discipline.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 2 of its 14 references that are in the map. First posted on arXiv 27 Jun 2025.

Builds on

2 of 14 references.

References · 2

  1. 2022The Fallacy of AI Functionalitycited by 88
  2. 2024Introducing v0.5 of the AI Safety Benchmark from MLCommonscited by 62

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond the Binary: A nuanced path for open-weight advanced AI ↗
  2. 2025Safety Must Precede the Deployment of Open-Ended AI
  3. 2026The safety failures we are not instrumenting: a perspective on hidden safety-critical challenges in modern AI systems
  4. 2024A Safe Harbor for AI Evaluation and Red Teaming
  5. 2026Taxonomy-Driven Analysis of Open-Source AI Risk Mitigation Tools
  6. 2024AI Risk Management Should Incorporate Both Safety and Security
  7. 2026ForesightSafety Bench: A Frontier Risk Evaluation and Governance Framework towards Safe AI
  8. 2024SafetyAnalyst: Interpretable, Transparent, and Steerable Safety Moderation for AI Behavior