mlsanityData to 7 Oct 2026

Towards best practices in AGI safety and governance: A survey of expert opinion

arXiv 2305.07153 ↗First posted 11 May 2023cs.CYcited by 27

Not on the map. Why?

Abstract (arXiv)

A number of leading AI companies, including OpenAI, Google DeepMind, and Anthropic, have the stated goal of building artificial general intelligence (AGI) - AI systems that achieve or exceed human performance across a wide range of cognitive tasks. In pursuing this goal, they may develop and deploy AI systems that pose particularly significant risks. While they have already taken some measures to mitigate these risks, best practices have not yet emerged. To support the identification of best practices, we sent a survey to 92 leading experts from AGI labs, academia, and civil society and received 51 responses. Participants were asked how much they agreed with 50 statements about what AGI labs should do. Our main finding is that participants, on average, agreed with all of them. Many statements received extremely high levels of agreement. For example, 98% of respondents somewhat or strongly agreed that AGI labs should conduct pre-deployment risk assessments, dangerous capabilities evaluations, third-party model audits, safety restrictions on model usage, and red teaming. Ultimately, our list of statements may serve as a helpful foundation for efforts to develop best practices, standards, and regulations for AGI labs.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 May 2023.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 12; 2024: 7; 2025: 5; 2026: 3.

27 papers.

Sort:

By area:

  1. 2023An Overview of Catastrophic AI Riskscited by 214
  2. 2023Can LLM-Generated Misinformation Be Detected?cited by 173
  3. 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
  4. 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 110
  5. 2023Evil Geniuses: Delving into the Safety of LLM-based Agentscited by 103
  6. 2023Frontier AI Regulation: Managing Emerging Risks to Public Safetycited by 95
  7. 2024Red-Teaming for Generative AI: Silver Bullet or Security Theater?cited by 81
  8. 2023Managing extreme AI risks amid rapid progresscited by 48
  9. 2024Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)cited by 44
  10. 2023Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Modelscited by 40
  11. 2025Model Tampering Attacks Enable More Rigorous Evaluations of LLM Capabilitiescited by 36
  12. 2023Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectivescited by 31
15 more
  1. 2024Can Editing LLMs Inject Harm?cited by 22
  2. 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscapecited by 18
  3. 2024Evaluating AI Evaluation: Perils and Prospectscited by 11
  4. 2024Responsible Reporting for Frontier AI Developmentcited by 10
  5. 2025STREAM (ChemBio): A Standard for Transparently Reporting Evaluations in AI Model Reportscited by 9
  6. 2025Thinking Beyond Tokens: From Brain-Inspired Intelligence to Cognitive Foundations for Artificial General Intelligence and its Societal Impactcited by 6
  7. 2023An International Consortium for Evaluations of Societal-Scale Risks from Advanced AIcited by 5
  8. 2023Towards Responsible Governance of Biological Design Toolscited by 5
  9. 2023The Chai Platform's AI Safety Frameworkcited by 1
  10. 2023Contextual Confidence and Generative AIcited by 1
  11. 2026Alignment Is Not Enough: A Relational Framework for Moral Standing in Human-AI Interactioncited by 1
  12. 2024Evaluating the Capabilities of LLMs for Supporting Anticipatory Impact Assessmentcited by 0
  13. 2025From Turing to Tomorrow: The UK's Approach to AI Regulationcited by 0
  14. 2026From Failure to Alignment: A Requirements Engineering Framework for Machine Learning Systemscited by 0
  15. 2026Silent Revision: Measuring Undisclosed Change in the Safety Frameworks of Frontier AI Developerscited by 0