IDs for AI Systems
Not on the map. Why?
Abstract (arXiv)
AI systems are increasingly pervasive, yet information needed to decide whether and how to engage with them may not exist or be accessible. A user may not be able to verify whether a system has certain safety certifications. An investigator may not know whom to investigate when a system causes an incident. It may not be clear whom to contact to shut down a malfunctioning system. Across a number of domains, IDs address analogous problems by identifying particular entities (e.g., a particular Boeing 747) and providing information about other entities of the same class (e.g., some or all Boeing 747s). We propose a framework in which IDs are ascribed to instances of AI systems (e.g., a particular chat session with Claude 3), and associated information is accessible to parties seeking to interact with that system. We characterize IDs for AI systems, provide concrete examples where IDs could be useful, argue that there could be significant demand for IDs from key actors, analyze how those actors could incentivize ID adoption, explore a potential implementation of our framework for deployers of AI systems, and highlight limitations and risks. IDs seem most warranted in settings where AI systems could have a large impact upon the world, such as in making financial transactions or contacting real humans. With further study, IDs could help to manage a world where AI systems pervade society.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 36 of its 86 references that are in the map. First posted on arXiv 17 Jun 2024.
Builds on
36 of 86 references.
References · 36
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2018Datasheets for Datasetscited by 1,371
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2018Model Cards for Model Reportingcited by 1,068
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 476
24 more
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
- 2023Role-Play with Large Language Modelscited by 290
- 2024Many-Shot In-Context Learningcited by 203
- 2023Augmenting Language Models with Long-Term Memorycited by 186
- 2023Model evaluation for extreme riskscited by 167
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
- 2023Harms from Increasingly Agentic Algorithmic Systemscited by 134
- 2024The Ethics of Advanced AI Assistantscited by 103
- 2023A Survey of Text Watermarking in the Era of Large Language Modelscited by 102
- 2023Evaluating Language-Model Agents on Realistic Autonomous Taskscited by 94
- 2022The Fallacy of AI Functionalitycited by 88
- 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Modelscited by 77
- 2024Visibility into AI Agentscited by 77
- 2024Here Comes The AI Worm: Unleashing Zero-click Worms that Target GenAI-Powered Applicationscited by 58
- 2023Ecosystem Graphs: The Social Footprint of Foundation Modelscited by 31
- 2024Algorithmic progress in language modelscited by 31
- 2021Data Hiding with Deep Learning: A Survey Unifying Digital Watermarking and Steganographycited by 23
- 2023Exposing Limitations of Language Model Agents in Sequential-Task Compositions on the Webcited by 23
- 2024GoEX: Perspectives and Designs Towards a Runtime for Autonomous LLM Applicationscited by 22
- 2022Reward Reports for Reinforcement Learningcited by 18
- 2023Oversight for Frontier AI through a Know-Your-Customer Scheme for Compute Providerscited by 12
- 2023WebWISE: Web Interface Control and Sequential Exploration with Large Language Modelscited by 11
- 2023Cooperative AI via Decentralized Commitment Devicescited by 7
Built on by
Citing papers per year: 2024: 1; 2025: 10; 2026: 7.
18 papers.
Sort:
By area:
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 66
- 2025Authenticated Delegation and Authorized AI Agentscited by 63
- 2024Hidden in Plain Text: Emergence & Mitigation of Steganographic Collusion in LLMscited by 52
- 2025SAGA: A Security Architecture for Governing AI Agentic Systemscited by 45
- 2025Infrastructure for AI Agentscited by 40
- 2025A Novel Zero-Trust Identity Framework for Agentic AI: Decentralized Authentication and Fine-Grained Access Controlcited by 26
- 2025The AI Agent Indexcited by 14
- 2025Identity Management for Agentic AI: The new frontier of authorization, authentication, and security for an AI agent worldcited by 14
- 2026How to Count AIs: Individuation and Liability for AI Agentscited by 5
- 2025LLM Agents Are the Antidote to Walled Gardenscited by 3
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governancecited by 3
- 2026Architecting Trust in Artificial Epistemic Agentscited by 3
6 more
- 2026Distributed General-Purpose Agent Networks: Architecture, Key Mechanisms, and Prototypescited by 3
- 2026Steganalysis of Adaptive Covert Collusion in Tool-Using Agent Populations: A Black-Box, Cross-Principal Approachcited by 2
- 2026Attacks and Mitigations for Distributed Governance of Agentic AI under Byzantine Adversariescited by 1
- 2025From Turing to Tomorrow: The UK's Approach to AI Regulationcited by 0
- 2026The Agentic Web Requires New Normative Infrastructurecited by 0
- 2026Binding Biometrics with AI Agent Identifiers for Delegation of Authoritycited by 0
- 2026Binding Biometrics with AI Agent Identifiers for Delegation of Authority4 Aug 2026
- 2026Steganalysis of Adaptive Covert Collusion in Tool-Using Agent Populations: A Black-Box, Cross-Principal Approach3 Aug 2026
- 2026Distributed General-Purpose Agent Networks: Architecture, Key Mechanisms, and Prototypes15 Jun 2026
- 2026The Agentic Web Requires New Normative Infrastructure9 Jun 2026
- 2026Attacks and Mitigations for Distributed Governance of Agentic AI under Byzantine Adversaries12 May 2026
- 2026Architecting Trust in Artificial Epistemic Agents3 Mar 2026
- 2026How to Count AIs: Individuation and Liability for AI Agents24 Feb 2026
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governance30 Nov 2025
- 2025Identity Management for Agentic AI: The new frontier of authorization, authentication, and security for an AI agent world29 Oct 2025
- 2025From Turing to Tomorrow: The UK's Approach to AI Regulation3 Jul 2025
- 2025LLM Agents Are the Antidote to Walled Gardens30 Jun 2025
- 2025A Novel Zero-Trust Identity Framework for Agentic AI: Decentralized Authentication and Fine-Grained Access Control25 May 2025
6 more
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents4 May 2025
- 2025SAGA: A Security Architecture for Governing AI Agentic Systems27 Apr 2025
- 2025The AI Agent Index3 Feb 2025
- 2025Infrastructure for AI Agents17 Jan 2025
- 2025Authenticated Delegation and Authorized AI Agents16 Jan 2025
- 2024Hidden in Plain Text: Emergence & Mitigation of Steganographic Collusion in LLMs2 Oct 2024
- 2025SAGA: A Security Architecture for Governing AI Agentic Systemscited by 45
- 2025A Novel Zero-Trust Identity Framework for Agentic AI: Decentralized Authentication and Fine-Grained Access Controlcited by 26
- 2025The AI Agent Indexcited by 14
- 2025Identity Management for Agentic AI: The new frontier of authorization, authentication, and security for an AI agent worldcited by 14
- 2025LLM Agents Are the Antidote to Walled Gardenscited by 3
- 2026Architecting Trust in Artificial Epistemic Agentscited by 3
- 2026Distributed General-Purpose Agent Networks: Architecture, Key Mechanisms, and Prototypescited by 3
- 2026Steganalysis of Adaptive Covert Collusion in Tool-Using Agent Populations: A Black-Box, Cross-Principal Approachcited by 2
- 2026The Agentic Web Requires New Normative Infrastructurecited by 0
- 2026Steganalysis of Adaptive Covert Collusion in Tool-Using Agent Populations: A Black-Box, Cross-Principal Approach3 Aug 2026
- 2026Distributed General-Purpose Agent Networks: Architecture, Key Mechanisms, and Prototypes15 Jun 2026
- 2026The Agentic Web Requires New Normative Infrastructure9 Jun 2026
- 2026Architecting Trust in Artificial Epistemic Agents3 Mar 2026
- 2025Identity Management for Agentic AI: The new frontier of authorization, authentication, and security for an AI agent world29 Oct 2025
- 2025LLM Agents Are the Antidote to Walled Gardens30 Jun 2025
- 2025A Novel Zero-Trust Identity Framework for Agentic AI: Decentralized Authentication and Fine-Grained Access Control25 May 2025
- 2025SAGA: A Security Architecture for Governing AI Agentic Systems27 Apr 2025
- 2025The AI Agent Index3 Feb 2025
- 2025Authenticated Delegation and Authorized AI Agentscited by 63
- 2024Hidden in Plain Text: Emergence & Mitigation of Steganographic Collusion in LLMscited by 52
- 2025Infrastructure for AI Agentscited by 40
- 2026How to Count AIs: Individuation and Liability for AI Agentscited by 5
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governancecited by 3
- 2026Attacks and Mitigations for Distributed Governance of Agentic AI under Byzantine Adversariescited by 1
- 2025From Turing to Tomorrow: The UK's Approach to AI Regulationcited by 0
- 2026Binding Biometrics with AI Agent Identifiers for Delegation of Authoritycited by 0
- 2026Binding Biometrics with AI Agent Identifiers for Delegation of Authority4 Aug 2026
- 2026Attacks and Mitigations for Distributed Governance of Agentic AI under Byzantine Adversaries12 May 2026
- 2026How to Count AIs: Individuation and Liability for AI Agents24 Feb 2026
- 2025On the Regulatory Potential of User Interfaces for AI Agent Governance30 Nov 2025
- 2025From Turing to Tomorrow: The UK's Approach to AI Regulation3 Jul 2025
- 2025Infrastructure for AI Agents17 Jan 2025
- 2025Authenticated Delegation and Authorized AI Agents16 Jan 2025
- 2024Hidden in Plain Text: Emergence & Mitigation of Steganographic Collusion in LLMs2 Oct 2024