Safety cases for frontier AI
Not on the map. Why?
Abstract (arXiv)
As frontier artificial intelligence (AI) systems become more capable, it becomes more important that developers can explain why their systems are sufficiently safe. One way to do so is via safety cases: reports that make a structured argument, supported by evidence, that a system is safe enough in a given operational context. Safety cases are already common in other safety-critical industries such as aviation and nuclear power. In this paper, we explain why they may also be a useful tool in frontier AI governance, both in industry self-regulation and government regulation. We then discuss the practicalities of safety cases, outlining how to produce a frontier AI safety case and discussing what still needs to happen before safety cases can substantially inform decisions.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Oct 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 2; 2025: 9; 2026: 7.
18 papers.
Sort:
By area:
- 2025Levels of Autonomy for AI Agentscited by 48
- 2025Evaluating Frontier Models for Stealth and Situational Awarenesscited by 37
- 2024Evaluation-Driven Development and Operations of LLM Agents: A Process Model and Reference Architecturecited by 11
- 2025The Singapore Consensus on Global AI Safety Research Prioritiescited by 10
- 2025STREAM (ChemBio): A Standard for Transparently Reporting Evaluations in AI Model Reportscited by 10
- 2025Manipulation Attacks by Misaligned AI: Risk Analysis and Safety Case Frameworkcited by 5
- 2026Tool Use Enables Undetectable Steganography in Multi-Agent LLM Systemscited by 5
- 2025International Agreements on AI Safety: Review and Recommendations for a Conditional AI Safety Treatycited by 4
- 2025An Example Safety Case for Safeguards Against Misusecited by 4
- 2025Misalignment or misuse? The AGI alignment tradeoffcited by 4
- 2026LURE: Live-Usage Replay Evaluations for Reducing Evaluation Awarenesscited by 4
- 2025Against racing to AGI: Cooperation, deterrence, and catastrophic riskscited by 2
6 more
- 2026Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demandscited by 2
- 2024Quantifying detection rates for dangerous capabilities: a theoretical model of dangerous capability evaluationscited by 1
- 2026Open Problems in AI Incident Governancecited by 1
- 2026Incentive Aware AI Regulations: A Credal Characterisationcited by 0
- 2026Questionnaire Responses Do not Capture the Safety of AI Agentscited by 0
- 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speechcited by 0
- 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speech6 Jul 2026
- 2026Open Problems in AI Incident Governance6 Jul 2026
- 2026Tool Use Enables Undetectable Steganography in Multi-Agent LLM Systems25 Jun 2026
- 2026Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demands14 May 2026
- 2026LURE: Live-Usage Replay Evaluations for Reducing Evaluation Awareness8 Apr 2026
- 2026Questionnaire Responses Do not Capture the Safety of AI Agents15 Mar 2026
- 2026Incentive Aware AI Regulations: A Credal Characterisation5 Mar 2026
- 2025STREAM (ChemBio): A Standard for Transparently Reporting Evaluations in AI Model Reports13 Aug 2025
- 2025Against racing to AGI: Cooperation, deterrence, and catastrophic risks29 Jul 2025
- 2025Manipulation Attacks by Misaligned AI: Risk Analysis and Safety Case Framework17 Jul 2025
- 2025The Singapore Consensus on Global AI Safety Research Priorities25 Jun 2025
- 2025Levels of Autonomy for AI Agents14 Jun 2025
6 more
- 2025Misalignment or misuse? The AGI alignment tradeoff4 Jun 2025
- 2025An Example Safety Case for Safeguards Against Misuse23 May 2025
- 2025Evaluating Frontier Models for Stealth and Situational Awareness2 May 2025
- 2025International Agreements on AI Safety: Review and Recommendations for a Conditional AI Safety Treaty18 Mar 2025
- 2024Quantifying detection rates for dangerous capabilities: a theoretical model of dangerous capability evaluations19 Dec 2024
- 2024Evaluation-Driven Development and Operations of LLM Agents: A Process Model and Reference Architecture21 Nov 2024
- 2025Levels of Autonomy for AI Agentscited by 48
- 2025Evaluating Frontier Models for Stealth and Situational Awarenesscited by 37
- 2025The Singapore Consensus on Global AI Safety Research Prioritiescited by 10
- 2025STREAM (ChemBio): A Standard for Transparently Reporting Evaluations in AI Model Reportscited by 10
- 2025Manipulation Attacks by Misaligned AI: Risk Analysis and Safety Case Frameworkcited by 5
- 2025International Agreements on AI Safety: Review and Recommendations for a Conditional AI Safety Treatycited by 4
- 2025An Example Safety Case for Safeguards Against Misusecited by 4
- 2025Misalignment or misuse? The AGI alignment tradeoffcited by 4
- 2026LURE: Live-Usage Replay Evaluations for Reducing Evaluation Awarenesscited by 4
- 2025Against racing to AGI: Cooperation, deterrence, and catastrophic riskscited by 2
- 2026Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demandscited by 2
- 2024Quantifying detection rates for dangerous capabilities: a theoretical model of dangerous capability evaluationscited by 1
12 most cited of 15 All 15 (JSON)
- 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speech6 Jul 2026
- 2026Open Problems in AI Incident Governance6 Jul 2026
- 2026Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demands14 May 2026
- 2026LURE: Live-Usage Replay Evaluations for Reducing Evaluation Awareness8 Apr 2026
- 2026Incentive Aware AI Regulations: A Credal Characterisation5 Mar 2026
- 2025STREAM (ChemBio): A Standard for Transparently Reporting Evaluations in AI Model Reports13 Aug 2025
- 2025Against racing to AGI: Cooperation, deterrence, and catastrophic risks29 Jul 2025
- 2025Manipulation Attacks by Misaligned AI: Risk Analysis and Safety Case Framework17 Jul 2025
- 2025The Singapore Consensus on Global AI Safety Research Priorities25 Jun 2025
- 2025Levels of Autonomy for AI Agents14 Jun 2025
- 2025Misalignment or misuse? The AGI alignment tradeoff4 Jun 2025
- 2025An Example Safety Case for Safeguards Against Misuse23 May 2025
12 newest of 15 All 15 (JSON)