Safety case template for frontier AI: A cyber inability argument
Not on the map. Why?
Abstract (arXiv)
Frontier artificial intelligence (AI) systems pose increasing risks to society, making it essential for developers to provide assurances about their safety. One approach to offering such assurances is through a safety case: a structured, evidence-based argument aimed at demonstrating why the risk associated with a safety-critical system is acceptable. In this article, we propose a safety case template for offensive cyber capabilities. We illustrate how developers could argue that a model does not have capabilities posing unacceptable cyber risks by breaking down the main claim into progressively specific sub-claims, each supported by evidence. In our template, we identify a number of risk models, derive proxy tasks from the risk models, define evaluation settings for the proxy tasks, and connect those with evaluation results. Elements of current frontier safety techniques - such as risk models, proxy tasks, and capability evaluations - use implicit arguments for overall system safety. This safety case template integrates these elements using the Claims Arguments Evidence (CAE) framework in order to make safety arguments coherent and explicit. While uncertainties around the specifics remain, this template serves as a proof of concept, aiming to foster discussion on AI safety cases and advance AI assurance.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Nov 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 2; 2025: 15; 2026: 2.
19 papers.
Sort:
By area:
- 2025Levels of Autonomy for AI Agentscited by 45
- 2025A sketch of an AI control safety casecited by 36
- 2025Evaluating Frontier Models for Stealth and Situational Awarenesscited by 30
- 2025A Framework for Evaluating Emerging Cyberattack Capabilities of AIcited by 15
- 2025An alignment safety case sketch based on debatecited by 12
- 2025STREAM (ChemBio): A Standard for Transparently Reporting Evaluations in AI Model Reportscited by 9
- 2025A Frontier AI Risk Management Framework: Bridging the Gap Between Current AI Practices and Established Risk Managementcited by 8
- 2025Systematic Hazard Analysis for Frontier AI using STPAcited by 6
- 2025Practical challenges of control monitoring in frontier AI deploymentscited by 6
- 2024What AI evaluations for preventing catastrophic risks can and cannot docited by 4
- 2025Mapping AI Benchmark Data to Quantitative Risk Estimates Through Expert Elicitationcited by 4
- 2025An Example Safety Case for Safeguards Against Misusecited by 4
7 more
- 2025Manipulation Attacks by Misaligned AI: Risk Analysis and Safety Case Frameworkcited by 4
- 2025International Agreements on AI Safety: Review and Recommendations for a Conditional AI Safety Treatycited by 3
- 2024Quantifying detection rates for dangerous capabilities: a theoretical model of dangerous capability evaluationscited by 1
- 2025AI threats to national security can be countered through an incident regimecited by 1
- 2026Clear, Compelling Arguments: Rethinking the Foundations of Frontier AI Safety Casescited by 1
- 2026Comprehensive AI governance requires addressing non-model gainscited by 1
- 2025OntoGSN: An Ontology-Based Framework for Semantic Management and Extension of Assurance Casescited by 0
- 2026Comprehensive AI governance requires addressing non-model gains1 May 2026
- 2026Clear, Compelling Arguments: Rethinking the Foundations of Frontier AI Safety Cases8 Mar 2026
- 2025Practical challenges of control monitoring in frontier AI deployments15 Dec 2025
- 2025STREAM (ChemBio): A Standard for Transparently Reporting Evaluations in AI Model Reports13 Aug 2025
- 2025Manipulation Attacks by Misaligned AI: Risk Analysis and Safety Case Framework17 Jul 2025
- 2025Levels of Autonomy for AI Agents14 Jun 2025
- 2025Systematic Hazard Analysis for Frontier AI using STPA2 Jun 2025
- 2025An Example Safety Case for Safeguards Against Misuse23 May 2025
- 2025OntoGSN: An Ontology-Based Framework for Semantic Management and Extension of Assurance Cases20 May 2025
- 2025An alignment safety case sketch based on debate6 May 2025
- 2025Evaluating Frontier Models for Stealth and Situational Awareness2 May 2025
- 2025AI threats to national security can be countered through an incident regime25 Mar 2025
7 more
- 2025International Agreements on AI Safety: Review and Recommendations for a Conditional AI Safety Treaty18 Mar 2025
- 2025A Framework for Evaluating Emerging Cyberattack Capabilities of AI14 Mar 2025
- 2025Mapping AI Benchmark Data to Quantitative Risk Estimates Through Expert Elicitation6 Mar 2025
- 2025A Frontier AI Risk Management Framework: Bridging the Gap Between Current AI Practices and Established Risk Management10 Feb 2025
- 2025A sketch of an AI control safety case28 Jan 2025
- 2024Quantifying detection rates for dangerous capabilities: a theoretical model of dangerous capability evaluations19 Dec 2024
- 2024What AI evaluations for preventing catastrophic risks can and cannot do26 Nov 2024
- 2025A sketch of an AI control safety casecited by 36
- 2025A sketch of an AI control safety case28 Jan 2025
- 2025Levels of Autonomy for AI Agentscited by 45
- 2025Evaluating Frontier Models for Stealth and Situational Awarenesscited by 30
- 2025A Framework for Evaluating Emerging Cyberattack Capabilities of AIcited by 15
- 2025An alignment safety case sketch based on debatecited by 12
- 2025STREAM (ChemBio): A Standard for Transparently Reporting Evaluations in AI Model Reportscited by 9
- 2025A Frontier AI Risk Management Framework: Bridging the Gap Between Current AI Practices and Established Risk Managementcited by 8
- 2025Systematic Hazard Analysis for Frontier AI using STPAcited by 6
- 2025Practical challenges of control monitoring in frontier AI deploymentscited by 6
- 2024What AI evaluations for preventing catastrophic risks can and cannot docited by 4
- 2025Mapping AI Benchmark Data to Quantitative Risk Estimates Through Expert Elicitationcited by 4
- 2025An Example Safety Case for Safeguards Against Misusecited by 4
- 2025Manipulation Attacks by Misaligned AI: Risk Analysis and Safety Case Frameworkcited by 4
12 most cited of 18 All 18 (JSON)
- 2026Comprehensive AI governance requires addressing non-model gains1 May 2026
- 2026Clear, Compelling Arguments: Rethinking the Foundations of Frontier AI Safety Cases8 Mar 2026
- 2025Practical challenges of control monitoring in frontier AI deployments15 Dec 2025
- 2025STREAM (ChemBio): A Standard for Transparently Reporting Evaluations in AI Model Reports13 Aug 2025
- 2025Manipulation Attacks by Misaligned AI: Risk Analysis and Safety Case Framework17 Jul 2025
- 2025Levels of Autonomy for AI Agents14 Jun 2025
- 2025Systematic Hazard Analysis for Frontier AI using STPA2 Jun 2025
- 2025An Example Safety Case for Safeguards Against Misuse23 May 2025
- 2025OntoGSN: An Ontology-Based Framework for Semantic Management and Extension of Assurance Cases20 May 2025
- 2025An alignment safety case sketch based on debate6 May 2025
- 2025Evaluating Frontier Models for Stealth and Situational Awareness2 May 2025
- 2025AI threats to national security can be countered through an incident regime25 Mar 2025
12 newest of 18 All 18 (JSON)