# International Agreements on AI Safety: Review and Recommendations for a Conditional AI Safety Treaty

arXiv: https://arxiv.org/abs/2503.18956 · HTML: https://mlsanity.com/paper/2503.18956/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 20 of its 62 references that are in the map.
- First posted on arXiv 18 Mar 2025.

## Builds on (most cited first, 20 of 20)

- [Model evaluation for extreme risks](https://mlsanity.com/paper/2305.15324/) (2023)
- [Black-Box Access is Insufficient for Rigorous AI Audits](https://mlsanity.com/paper/2401.14446/) (2024)
- [Computing Power and the Governance of Artificial Intelligence](https://mlsanity.com/paper/2402.08797/) (2024)
- [Safety case template for frontier AI: A cyber inability argument](https://mlsanity.com/paper/2411.08088/) (2024)
- [On the Limitations of Compute Thresholds as a Governance Strategy](https://mlsanity.com/paper/2407.05694/) (2024)
- [Safety cases for frontier AI](https://mlsanity.com/paper/2410.21572/) (2024)
- [Training Compute Thresholds: Features and Functions in AI Regulation](https://mlsanity.com/paper/2405.10799/) (2024)
- [Coordinated pausing: An evaluation-based coordination scheme for frontier AI developers](https://mlsanity.com/paper/2310.00374/) (2023)
- [Oversight for Frontier AI through a Know-Your-Customer Scheme for Compute Providers](https://mlsanity.com/paper/2310.13625/) (2023)
- [Governing Through the Cloud: The Intermediary Role of Compute Providers in AI Regulation](https://mlsanity.com/paper/2403.08501/) (2024)
- [Responsible Reporting for Frontier AI Development](https://mlsanity.com/paper/2404.02675/) (2024)
- [Verification methods for international AI agreements](https://mlsanity.com/paper/2408.16074/) (2024)
- [International Governance of Civilian AI: A Jurisdictional Certification Approach](https://mlsanity.com/paper/2308.15514/) (2023)
- [The Role of Governments in Increasing Interconnected Post-Deployment Monitoring of AI](https://mlsanity.com/paper/2410.04931/) (2024)
- [An international treaty to implement a global compute cap for advanced artificial intelligence](https://mlsanity.com/paper/2311.10748/) (2023)
- [Taking control: Policies to address extinction risks from advanced AI](https://mlsanity.com/paper/2310.20563/) (2023)
- [Affirmative safety: An approach to risk management for high-risk AI](https://mlsanity.com/paper/2406.15371/) (2024)
- [Who Should Run Advanced AI Evaluations -- AISIs?](https://mlsanity.com/paper/2407.20847/) (2024)
- [Governing dual-use technologies: Case studies of international security agreements and lessons for AI governance](https://mlsanity.com/paper/2409.02779/) (2024)
- [Multinational AGI Consortium (MAGIC): A Proposal for International Coordination on AI](https://mlsanity.com/paper/2310.09217/) (2023)

## Built on by (most cited first, 4 of 4)

- [Distributional AGI Safety](https://mlsanity.com/paper/2512.16856/) (2025)
- [Technical Requirements for Halting Dangerous AI Activities](https://mlsanity.com/paper/2507.09801/) (2025)
- [International Agreements to Limit Frontier AI: Objectives and Exit](https://mlsanity.com/paper/2607.16224/) (2026)
- [Beyond Training: A Feasibility Taxonomy for Inference-Time AI Governance](https://mlsanity.com/paper/2609.10105/) (2026)

## Abstract (arXiv)

The malicious use or malfunction of advanced general-purpose AI (GPAI) poses risks that, according to leading experts, could lead to the 'marginalisation or extinction of humanity.' To address these risks, there are an increasing number of proposals for international agreements on AI safety. In this paper, we review recent (2023-) proposals, identifying areas of consensus and disagreement, and drawing on related literature to assess their feasibility. We focus our discussion on risk thresholds, regulations, types of international agreement and five related processes: building scientific consensus, standardisation, auditing, verification and incentivisation. Based on this review, we propose a treaty establishing a compute threshold above which development requires rigorous oversight. This treaty would mandate complementary audits of models, information security and governance practices, overseen by an international network of AI Safety Institutes (AISIs) with authority to pause development if risks are unacceptable. Our approach combines immediately implementable measures with a flexible structure that can adapt to ongoing research.