The Why Behind the Action: Unveiling Internal Drivers via Agentic Attribution
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Large Language Model (LLM)-based agents are widely used in real-world applications such as customer service, web navigation, and software engineering. As these systems become more autonomous and are deployed at scale, understanding why an agent takes a particular action becomes increasingly important for accountability and governance. However, existing research predominantly focuses on textitfailure attribution to localize explicit errors in unsuccessful trajectories, which is insufficient for explaining the reason behind agent behaviors. To bridge this gap, we propose a novel framework for general agentic attribution, designed to identify the internal factors driving agent actions regardless of the task outcome. Our framework operates hierarchically to manage the complexity of agent interactions. Specifically, at the textitcomponent level, we employ temporal likelihood dynamics to identify critical interaction steps; then at the textitsentence level, we refine this localization using perturbation-based analysis to isolate the specific textual evidence. We validate our framework across a diverse suite of agentic scenarios, including standard tool use and subtle reliability risks like memory-induced bias. Experimental results demonstrate that the proposed framework reliably pinpoints pivotal historical events and sentences behind the agent behavior, offering a critical step toward safer and more accountable agentic systems. Codes are available at https://github.com/AI45Lab/AgentDoG.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 41 of its 48 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
41 of 48 references.
Closest ancestors · 5
Same direction, newest first
- 2025Where LLM Agents Fail and How They can Learn From Failures29 Sep
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?3 Sep
- 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems30 Apr
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future5 Aug
Other references · 36
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Let's Verify Step by Stepcited by 3,598
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
24 more
- 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 514
- 2024InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model Agentscited by 476
- 2025Humanity's Last Examcited by 467
- 2025Memory in the Age of AI Agentscited by 285
- 2016Rationalizing Neural Predictionscited by 281
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 194
- 2025Towards Scientific Intelligence: A Survey of LLM-based Scientific Agentscited by 96
- 2024ContextCite: Attributing Model Generation to Contextcited by 93
- 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
- 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systemscited by 58
- 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Surveycited by 52
- 2025Your Agent May Misevolve: Emergent Risks in Self-evolving LLM Agentscited by 52
- 2024Gradient based Feature Attribution in Explainable AI: A Technical Reviewcited by 34
- 2024Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generationcited by 25
- 2024AttriBoT: A Bag of Tricks for Efficiently Approximating Leave-One-Out Context Attributioncited by 23
- 2023TextGenSHAP: Scalable Post-hoc Explanations in Text Generation with Long Documentscited by 17
- 2025TokenShapley: Token Level Context Attribution with Shapley Valuecited by 14
- 2025Attributing Response to Context: A Jensen-Shannon Divergence Driven Mechanistic Study of Context Attribution in Retrieval-Augmented Generationcited by 12
- 2025Who Taught the Lie? Responsibility Attribution for Poisoned Knowledge in Retrieval-Augmented Generationcited by 12
- 2025Learning to Attribute with Attentioncited by 11
- 2025TracLLM: A Generic Framework for Attributing Long Context LLMscited by 11
- 2025Source Attribution in Retrieval-Augmented Generationcited by 7
- 2025Towards Self-Evolving Benchmarks: Synthesizing Agent Trajectories via Test-Time Exploration under Validate-by-Reproduce Paradigmcited by 5
- 2026Beyond the Black Box: A Survey on the Theory and Mechanism of Large Language Modelscited by 5
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systemscited by 8
- 2026MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systemscited by 5
- 2026Tracing Agentic Failure from the Flow of Successcited by 5
- 2026Long-Horizon Agent Trajectory Attribution: A Unified Benchmark and Fine-Grained Annotation Frameworkcited by 4
- 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agentscited by 3
- 2026Tell Me Why: Designing an Explainable LLM-based Dialogue System for Student Problem Behavior Diagnosiscited by 0
- 2026Entropy-Gradient Inversion: Moving Toward Internal Mechanism of Large Reasoning Modelscited by 0
- 2026Auditing Agent Actions through Query-Conditioned Attributioncited by 0
- 2026Auditing Agent Actions through Query-Conditioned Attribution27 Sep 2026
- 2026Long-Horizon Agent Trajectory Attribution: A Unified Benchmark and Fine-Grained Annotation Framework7 Aug 2026
- 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agents16 Jul 2026
- 2026Tracing Agentic Failure from the Flow of Success14 Jul 2026
- 2026MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems27 May 2026
- 2026Entropy-Gradient Inversion: Moving Toward Internal Mechanism of Large Reasoning Models18 May 2026
- 2026AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems9 May 2026
- 2026Tell Me Why: Designing an Explainable LLM-based Dialogue System for Student Problem Behavior Diagnosis24 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026From Features to Actions: Explainability in Traditional and Agentic AI Systems
- 2026ASCon: A Direction-Aware Reciprocal Agent--Step Contextualization Model for Failure Attribution in Multi-Agent Systems
- 2026Detect Before You Attribute: Cascade Failure Attribution for Multi-Agent Systems
- 2026DCFA: Dual-view Causal-inspired Attribution for Failure Reasoning in LLM-based Multi-agent Systems
- 2025Abduct, Act, Predict: Scaffolding Causal Inference for Automated Failure Attribution in Multi-Agent Systems
- 2026A Sober Look at Agentic Misalignment in Automated Workflows
- 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems
- 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Search