mlsanityData to 7 Oct 2026

Auditable Agents

arXiv 2604.05485 ↗First posted 7 Apr 2026cs.AIcited by 14

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

LLM agents call tools, query databases, delegate tasks, and trigger external side effects. Once an agent system can act in the world, the question is no longer only whether harmful actions can be prevented--it is whether those actions remain answerable after deployment. We distinguish accountability (the ability to determine compliance and assign responsibility), auditability (the system property that makes accountability possible), and auditing (the process of reconstructing behavior from trustworthy evidence). Our claim is direct: no agent system can be accountable without auditability. To make this operational, we define five dimensions of agent auditability, i.e., action recoverability, lifecycle coverage, policy checkability, responsibility attribution, and evidence integrity, and identify three mechanism classes (detect, enforce, recover) whose temporal information-and-intervention constraints explain why, in practice, no single approach suffices. We support the position with layered evidence rather than a single benchmark: lower-bound ecosystem measurements suggest that even basic security prerequisites for auditability are widely unmet (617 security findings across six prominent open-source projects); runtime feasibility results show that pre-execution mediation with tamper-evident records adds only 8.3 ms median overhead; and controlled recovery experiments show that responsibility-relevant information can be partially recovered even when conventional logs are missing. We propose an Auditability Card for agent systems and identify six open research problems organized by mechanism class.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 35 of its 48 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

35 of 48 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026No Attacker Needed: Unintentional Cross-User Contamination in Shared-State LLM Agents1 Apr
  2. 2026Agent Audit: A Security Analysis System for LLM Agent Applications24 Mar
  3. 2026The Autonomy Tax: Defense Training Breaks LLM Agents19 Mar
  4. 2025Topology Matters: Measuring Memory Leakage in Multi-Agent LLMs4 Dec
  5. 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agents24 Mar
  6. 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection17 Feb
  7. 2024Agent-SafetyBench: Evaluating the Safety of LLM Agents19 Dec
  8. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan
  9. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandbox25 Sep

Other references · 26

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  3. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  4. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  5. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  6. 2018Datasheets for Datasetscited by 1,371
  7. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  8. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  9. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,124
  10. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
  11. 2018Model Cards for Model Reportingcited by 1,068
  12. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
14 more
  1. 2024Executable Code Actions Elicit Better LLM Agentscited by 537
  2. 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
  3. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
  4. 2024SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decodingcited by 233
  5. 2023Auditing large language models: a three-layered approachcited by 135
  6. 2026Agent Skills for Large Language Models: Architecture, Acquisition, Security, and the Path Forwardcited by 105
  7. 2024Visibility into AI Agentscited by 77
  8. 2020Backstabber's Knife Collection: A Review of Open Source Software Supply Chain Attackscited by 57
  9. 2026AgentRx: Diagnosing AI Agent Failures from Execution Trajectoriescited by 53
  10. 2024AgentOps: Enabling Observability of LLM Agentscited by 46
  11. 2024AI auditing: The Broken Bus on the Road to AI Accountabilitycited by 42
  12. 2026Audit Trails for Accountability in Large Language Modelscited by 10
  13. 2026AEGIS: No Tool Call Left Unchecked -- A Pre-Execution Firewall and Audit Layer for AI Agentscited by 7
  14. 2026When Only the Final Text Survives: Implicit Execution Tracing for Multi-Agent Auditingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026When Agents Act Unwatched: The Reduced-Supervision Paradox in Agentic AI
  2. 2026From Traceability to Justifiability: Accountability Structures in Agentic Software Engineering
  3. 2025Verifiability-First Agents: Provable Observability and Lightweight Audit Agents for Controlling Autonomous LLM Systems
  4. 2025Traceability and Accountability in Role-Specialized Multi-Agent LLM Pipelines
  5. 2026AgentTrace: A Structured Logging Framework for Agent System Observability
  6. 2026Who Audits Whom, on What Substrate, with What Evidence? An Independence-Graded Audit Protocol for Agentic AI
  7. 2026Trustworthy Agentic AI: Failure Modes, Mitigation Strategies, and a Lifecycle Framework for Autonomous LLM Systems
  8. 2026Policy-Invisible Violations in LLM-Based Agents