Structured access: an emerging paradigm for safe AI deployment
Not on the map. Why?
Abstract (arXiv)
Structured access is an emerging paradigm for the safe deployment of artificial intelligence (AI). Instead of openly disseminating AI systems, developers facilitate controlled, arm's length interactions with their AI systems. The aim is to prevent dangerous AI capabilities from being widely accessible, whilst preserving access to AI capabilities that can be used safely. The developer must both restrict how the AI system can be used, and prevent the user from circumventing these restrictions through modification or reverse engineering of the AI system. Structured access is most effective when implemented through cloud-based AI services, rather than disseminating AI software that runs locally on users' hardware. Cloud-based interfaces provide the AI developer greater scope for controlling how the AI system is used, and for protecting against unauthorized modifications to the system's design. This chapter expands the discussion of "publication norms" in the AI community, which to date has focused on the question of how the informational content of AI research projects should be disseminated (e.g., code and models). Although this is an important question, there are limits to what can be achieved through the control of information flows. Structured access views AI software not only as information that can be shared but also as a tool with which users can have arm's length interactions. There are early examples of structured access being practiced by AI developers, but there is much room for further development, both in the functionality of cloud-based interfaces and in the wider institutional framework.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 9 of its 27 references that are in the map. First posted on arXiv 13 Jan 2022.
Builds on
9 of 27 references.
References · 9
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2016Stealing Machine Learning Models via Prediction APIscited by 602
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2020AI Research Considerations for Human Existential Safety (ARCHES)cited by 33
- 2021AdvParams: An Active DNN Intellectual Property Protection Technique via Adversarial Perturbation Based Parameter Encryptioncited by 11
- 2020Deep-Lock: Secure Authorization for Deep Neural Networkscited by 10
- 2018DeepObfuscation: Securing the Structure of Convolutional Neural Networks via Knowledge Distillationcited by 6
- 2019MimosaNet: An Unrobust Neural Network Preventing Model Stealingcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 15; 2024: 12; 2025: 5; 2026: 7.
40 papers.
Sort:
By area:
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
- 2023Model evaluation for extreme riskscited by 167
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
- 2024Large Language Model Unlearning via Embedding-Corrupted Promptscited by 112
- 2023Frontier AI Regulation: Managing Emerging Risks to Public Safetycited by 95
- 2024On the Societal Impact of Open Foundation Modelscited by 64
- 2023The Gradient of Generative AI Release: Methods and Considerationscited by 63
- 2023Spear Phishing With Large Language Modelscited by 49
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
- 2024NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internalscited by 43
- 2023Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectivescited by 31
- 2023Democratising AI: Multiple Meanings, Goals, and Methodscited by 29
28 more
- 2024The Compute Divide in Machine Learning: A Threat to Academic Contribution and Scrutiny?cited by 20
- 2024Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Datacited by 20
- 2024Holistic Safety and Responsibility Evaluations of Advanced AI Modelscited by 18
- 2023A Cost Analysis of Generative Language Models and Influence Operationscited by 17
- 2023Protecting Society from AI Misuse: When are Restrictions on Capabilities Warranted?cited by 15
- 2023Towards Publicly Accountable Frontier LLMs: Building an External Scrutiny Ecosystem under the ASPIRE Frameworkcited by 11
- 2024What is it for a Machine Learning Model to Have a Capability?cited by 10
- 2024Societal Adaptation to Advanced AIcited by 10
- 2025The 2025 Foundation Model Transparency Indexcited by 9
- 2023International Governance of Civilian AI: A Jurisdictional Certification Approachcited by 8
- 2022Actionable Guidance for High-Consequence AI Risk Management: Towards Standards Addressing AI Catastrophic Riskscited by 7
- 2023Hazards from Increasingly Accessible Fine-Tuning of Downloadable Foundation Modelscited by 7
- 2023Exploring the Relevance of Data Privacy-Enhancing Technologies for AI Governance Use Casescited by 5
- 2023An International Consortium for Evaluations of Societal-Scale Risks from Advanced AIcited by 5
- 2023Towards Responsible Governance of Biological Design Toolscited by 5
- 2025An Example Safety Case for Safeguards Against Misusecited by 4
- 2025Technical Requirements for Halting Dangerous AI Activitiescited by 2
- 2026Internal Deployment Gaps in AI Regulationcited by 2
- 2026Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demandscited by 2
- 2023Contextual Confidence and Generative AIcited by 1
- 2025Beyond Release: Access Considerations for Generative AI Systemscited by 1
- 2026A Content-Based Framework for Cybersecurity Refusal Decisions in Large Language Modelscited by 1
- 2026The Ethics of Autonomous AI Agents for Offensive Securitycited by 1
- 2024Considerations Influencing Offense-Defense Dynamics From Artificial Intelligencecited by 0
- 2025Recognition Without Mitigation: Ethical Frameworks in Autonomous Offensive-LLM Agent Researchcited by 0
- 2026A Privacy by Design Framework for Large Language Model-Based Applications for Childrencited by 0
- 2026Incentive Aware AI Regulations: A Credal Characterisationcited by 0
- 2026Agentic BAIM-LLM Evaluation (ABLE): Benchmarking LLM Use of Protein Design Toolscited by 0
- 2026Agentic BAIM-LLM Evaluation (ABLE): Benchmarking LLM Use of Protein Design Tools5 Sep 2026
- 2026The Ethics of Autonomous AI Agents for Offensive Security22 Jul 2026
- 2026Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demands14 May 2026
- 2026Incentive Aware AI Regulations: A Credal Characterisation5 Mar 2026
- 2026A Privacy by Design Framework for Large Language Model-Based Applications for Children19 Feb 2026
- 2026A Content-Based Framework for Cybersecurity Refusal Decisions in Large Language Models17 Feb 2026
- 2026Internal Deployment Gaps in AI Regulation12 Jan 2026
- 2025The 2025 Foundation Model Transparency Index11 Dec 2025
- 2025Technical Requirements for Halting Dangerous AI Activities13 Jul 2025
- 2025Recognition Without Mitigation: Ethical Frameworks in Autonomous Offensive-LLM Agent Research10 Jun 2025
- 2025An Example Safety Case for Safeguards Against Misuse23 May 2025
- 2025Beyond Release: Access Considerations for Generative AI Systems23 Feb 2025
28 more
- 2024Considerations Influencing Offense-Defense Dynamics From Artificial Intelligence5 Dec 2024
- 2024NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internals18 Jul 2024
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Models16 Jul 2024
- 2024Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data19 Jun 2024
- 2024Large Language Model Unlearning via Embedding-Corrupted Prompts12 Jun 2024
- 2024Societal Adaptation to Advanced AI16 May 2024
- 2024What is it for a Machine Learning Model to Have a Capability?14 May 2024
- 2024Holistic Safety and Responsibility Evaluations of Advanced AI Models22 Apr 2024
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning5 Mar 2024
- 2024On the Societal Impact of Open Foundation Models27 Feb 2024
- 2024Black-Box Access is Insufficient for Rigorous AI Audits25 Jan 2024
- 2024The Compute Divide in Machine Learning: A Threat to Academic Contribution and Scrutiny?4 Jan 2024
- 2023Hazards from Increasingly Accessible Fine-Tuning of Downloadable Foundation Models22 Dec 2023
- 2023Towards Responsible Governance of Biological Design Tools27 Nov 2023
- 2023Towards Publicly Accountable Frontier LLMs: Building an External Scrutiny Ecosystem under the ASPIRE Framework15 Nov 2023
- 2023Contextual Confidence and Generative AI2 Nov 2023
- 2023An International Consortium for Evaluations of Societal-Scale Risks from Advanced AI22 Oct 2023
- 2023Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectives29 Sep 2023
- 2023International Governance of Civilian AI: A Jurisdictional Certification Approach29 Aug 2023
- 2023A Cost Analysis of Generative Language Models and Influence Operations7 Aug 2023
- 2023Frontier AI Regulation: Managing Emerging Risks to Public Safety6 Jul 2023
- 2023Model evaluation for extreme risks24 May 2023
- 2023Spear Phishing With Large Language Models11 May 2023
- 2023Democratising AI: Multiple Meanings, Goals, and Methods22 Mar 2023
- 2023Protecting Society from AI Misuse: When are Restrictions on Capabilities Warranted?16 Mar 2023
- 2023Exploring the Relevance of Data Privacy-Enhancing Technologies for AI Governance Use Cases15 Mar 2023
- 2023The Gradient of Generative AI Release: Methods and Considerations5 Feb 2023
- 2022Actionable Guidance for High-Consequence AI Risk Management: Towards Standards Addressing AI Catastrophic Risks17 Jun 2022
- 2026A Content-Based Framework for Cybersecurity Refusal Decisions in Large Language Modelscited by 1
- 2026The Ethics of Autonomous AI Agents for Offensive Securitycited by 1
- 2025Recognition Without Mitigation: Ethical Frameworks in Autonomous Offensive-LLM Agent Researchcited by 0
- 2026Agentic BAIM-LLM Evaluation (ABLE): Benchmarking LLM Use of Protein Design Toolscited by 0
- 2026Agentic BAIM-LLM Evaluation (ABLE): Benchmarking LLM Use of Protein Design Tools5 Sep 2026
- 2026The Ethics of Autonomous AI Agents for Offensive Security22 Jul 2026
- 2026A Content-Based Framework for Cybersecurity Refusal Decisions in Large Language Models17 Feb 2026
- 2025Recognition Without Mitigation: Ethical Frameworks in Autonomous Offensive-LLM Agent Research10 Jun 2025
- 2023Model evaluation for extreme riskscited by 167
- 2024Black-Box Access is Insufficient for Rigorous AI Auditscited by 123
- 2023Frontier AI Regulation: Managing Emerging Risks to Public Safetycited by 95
- 2024On the Societal Impact of Open Foundation Modelscited by 64
- 2023The Gradient of Generative AI Release: Methods and Considerationscited by 63
- 2023Spear Phishing With Large Language Modelscited by 49
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
- 2024NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internalscited by 43
- 2023Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectivescited by 31
- 2023Democratising AI: Multiple Meanings, Goals, and Methodscited by 29
- 2024The Compute Divide in Machine Learning: A Threat to Academic Contribution and Scrutiny?cited by 20
- 2024Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Datacited by 20
12 most cited of 34 All 34 (JSON)
- 2026Position: Behavioural Assurance Cannot Verify the Safety Claims Governance Now Demands14 May 2026
- 2026Incentive Aware AI Regulations: A Credal Characterisation5 Mar 2026
- 2026A Privacy by Design Framework for Large Language Model-Based Applications for Children19 Feb 2026
- 2026Internal Deployment Gaps in AI Regulation12 Jan 2026
- 2025The 2025 Foundation Model Transparency Index11 Dec 2025
- 2025Technical Requirements for Halting Dangerous AI Activities13 Jul 2025
- 2025An Example Safety Case for Safeguards Against Misuse23 May 2025
- 2025Beyond Release: Access Considerations for Generative AI Systems23 Feb 2025
- 2024Considerations Influencing Offense-Defense Dynamics From Artificial Intelligence5 Dec 2024
- 2024NNsight and NDIF: Democratizing Access to Open-Weight Foundation Model Internals18 Jul 2024
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Models16 Jul 2024
- 2024Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Data19 Jun 2024
12 newest of 34 All 34 (JSON)