Who Owns This Agent? Tracing AI Agents Back to Their Owners
Not on the map. Why?
Abstract (arXiv)
AI agents increasingly act autonomously in the world, yet harmful behavior cannot be reliably traced to the account that deployed the agent. This creates an accountability gap across both benign and malicious settings: misconfigured or hijacked agents may cause unintended harm, while malicious operators may deploy agents for scams, harassment, or cyberattacks. In many cases, these agents rely on vendor-hosted language models. Affected parties can observe the harm, but cannot identify the responsible vendor session or account. We formalize this problem as agent attribution: linking an observed agent interaction to the account responsible for the underlying model calls. We present a canary-based protocol in which an authorized party embeds selected signals in content consumed by the agent, then asks the vendor to search a narrow time window of account-linked session logs. Lexical canaries provide exact-match attribution when a benign operator does not deliberately evade detection. Against adaptive adversaries, we use task-relevant semantic canaries whose removal or replacement also removes information required for successful task execution, creating a utility--evasion asymmetry. Across communication, web, and cyber-agent settings, we show that the protocol supports reliable session attribution, withstands adaptive transformations, and scales to practical vendor-side log search.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 55 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
21 of 55 references.
References · 21
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2016Concrete Problems in AI Safetycited by 1,642
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2022Red Teaming Language Models with Language Modelscited by 1,026
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
- 2023Can AI-Generated Text be Reliably Detected?cited by 386
- 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
- 2023Provable Robust Watermarking for AI-Generated Textcited by 299
- 2023Poisoning Web-Scale Training Datasets is Practicalcited by 290
9 more
- 2019Risks from Learned Optimization in Advanced Machine Learning Systemscited by 258
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 258
- 2023An Overview of Catastrophic AI Riskscited by 222
- 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 158
- 2024Teams of LLM Agents can Exploit Zero-Day Vulnerabilitiescited by 95
- 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Modelscited by 87
- 2024LLMmap: Fingerprinting For Large Language Modelscited by 58
- 2026Building Production-Ready Probes For Geminicited by 47
- 2023Anatomy of an AI-powered malicious social botnetcited by 36
Built on by
Not cited yet.