mlsanityData to 7 Oct 2026

IDs for AI Systems

arXiv 2406.12137 ↗First posted 17 Jun 2024cs.AIcited by 18

Not on the map. Why?

Abstract (arXiv)

AI systems are increasingly pervasive, yet information needed to decide whether and how to engage with them may not exist or be accessible. A user may not be able to verify whether a system has certain safety certifications. An investigator may not know whom to investigate when a system causes an incident. It may not be clear whom to contact to shut down a malfunctioning system. Across a number of domains, IDs address analogous problems by identifying particular entities (e.g., a particular Boeing 747) and providing information about other entities of the same class (e.g., some or all Boeing 747s). We propose a framework in which IDs are ascribed to instances of AI systems (e.g., a particular chat session with Claude 3), and associated information is accessible to parties seeking to interact with that system. We characterize IDs for AI systems, provide concrete examples where IDs could be useful, argue that there could be significant demand for IDs from key actors, analyze how those actors could incentivize ID adoption, explore a potential implementation of our framework for deployers of AI systems, and highlight limitations and risks. IDs seem most warranted in settings where AI systems could have a large impact upon the world, such as in making financial transactions or contacting real humans. With further study, IDs could help to manage a world where AI systems pervade society.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 36 of its 86 references that are in the map. First posted on arXiv 17 Jun 2024.

Builds on

36 of 86 references.

References · 36

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  4. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  5. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  6. 2018Datasheets for Datasetscited by 1,371
  7. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  8. 2023AgentBench: Evaluating LLMs as Agentscited by 1,211
  9. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  10. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  11. 2018Model Cards for Model Reportingcited by 1,068
  12. 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 476
24 more
  1. 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
  2. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
  3. 2023Role-Play with Large Language Modelscited by 290
  4. 2024Many-Shot In-Context Learningcited by 203
  5. 2023Augmenting Language Models with Long-Term Memorycited by 186
  6. 2023Model evaluation for extreme riskscited by 167
  7. 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 154
  8. 2023Harms from Increasingly Agentic Algorithmic Systemscited by 134
  9. 2024The Ethics of Advanced AI Assistantscited by 103
  10. 2023A Survey of Text Watermarking in the Era of Large Language Modelscited by 102
  11. 2023Evaluating Language-Model Agents on Realistic Autonomous Taskscited by 94
  12. 2022The Fallacy of AI Functionalitycited by 88
  13. 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Modelscited by 77
  14. 2024Visibility into AI Agentscited by 77
  15. 2024Here Comes The AI Worm: Unleashing Zero-click Worms that Target GenAI-Powered Applicationscited by 58
  16. 2023Ecosystem Graphs: The Social Footprint of Foundation Modelscited by 31
  17. 2024Algorithmic progress in language modelscited by 31
  18. 2021Data Hiding with Deep Learning: A Survey Unifying Digital Watermarking and Steganographycited by 23
  19. 2023Exposing Limitations of Language Model Agents in Sequential-Task Compositions on the Webcited by 23
  20. 2024GoEX: Perspectives and Designs Towards a Runtime for Autonomous LLM Applicationscited by 22
  21. 2022Reward Reports for Reinforcement Learningcited by 18
  22. 2023Oversight for Frontier AI through a Know-Your-Customer Scheme for Compute Providerscited by 12
  23. 2023WebWISE: Web Interface Control and Sequential Exploration with Large Language Modelscited by 11
  24. 2023Cooperative AI via Decentralized Commitment Devicescited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 10; 2026: 7.

18 papers.

Sort:

By area:

  1. 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 66
  2. 2025Authenticated Delegation and Authorized AI Agentscited by 63
  3. 2024Hidden in Plain Text: Emergence & Mitigation of Steganographic Collusion in LLMscited by 52
  4. 2025SAGA: A Security Architecture for Governing AI Agentic Systemscited by 45
  5. 2025Infrastructure for AI Agentscited by 40
  6. 2025A Novel Zero-Trust Identity Framework for Agentic AI: Decentralized Authentication and Fine-Grained Access Controlcited by 26
  7. 2025The AI Agent Indexcited by 14
  8. 2025Identity Management for Agentic AI: The new frontier of authorization, authentication, and security for an AI agent worldcited by 14
  9. 2026How to Count AIs: Individuation and Liability for AI Agentscited by 5
  10. 2025LLM Agents Are the Antidote to Walled Gardenscited by 3
  11. 2025On the Regulatory Potential of User Interfaces for AI Agent Governancecited by 3
  12. 2026Architecting Trust in Artificial Epistemic Agentscited by 3
6 more
  1. 2026Distributed General-Purpose Agent Networks: Architecture, Key Mechanisms, and Prototypescited by 3
  2. 2026Steganalysis of Adaptive Covert Collusion in Tool-Using Agent Populations: A Black-Box, Cross-Principal Approachcited by 2
  3. 2026Attacks and Mitigations for Distributed Governance of Agentic AI under Byzantine Adversariescited by 1
  4. 2025From Turing to Tomorrow: The UK's Approach to AI Regulationcited by 0
  5. 2026The Agentic Web Requires New Normative Infrastructurecited by 0
  6. 2026Binding Biometrics with AI Agent Identifiers for Delegation of Authoritycited by 0