Beyond Fluency: Toward Reliable Trajectories in Agentic IR
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Information Retrieval is shifting from passive document ranking toward autonomous agentic workflows that operate in multi-step Reason-Act-Observe loops. In such long-horizon trajectories, minor early errors can cascade, leading to functional misalignment between internal reasoning and external tool execution despite continued linguistic fluency. This position paper synthesizes failure modes observed in industrial agentic systems, categorizing errors across planning, retrieval, reasoning, and execution. We argue that safe deployment requires moving beyond endpoint accuracy toward trajectory integrity and causal attribution. To address compounding error and deceptive fluency, we propose verification gates at each interaction unit and advocate systematic abstention under calibrated uncertainty. Reliable Agentic IR systems must prioritize process correctness and grounded execution over plausible but unverified completion.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 24 of its 58 references that are in the map. First posted on arXiv 5 Apr 2026.
Builds on
24 of 58 references.
References · 24
- 2020Language Models are Few-Shot Learnerscited by 32,320
- 2017On Calibration of Modern Neural Networkscited by 4,902
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,117
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,902
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,949
- 2022Survey of Hallucination in Natural Language Generationcited by 2,068
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,313
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,222
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,219
- 2024Understanding the planning of LLM agents: A surveycited by 416
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 331
- 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 312
12 more
- 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 147
- 2025SPA-RL: Reinforcing LLM Agents via Stepwise Progress Attributioncited by 69
- 2020TREC CAsT 2019: The Conversational Assistance Track Overviewcited by 64
- 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Taskscited by 64
- 2025TRiSM for Agentic AI: A Review of Trust, Risk, and Security Management in LLM-based Agentic Multi-Agent Systemscited by 59
- 2025GUARDIAN: Safeguarding LLM Multi-Agent Collaborations with Temporal Graph Modelingcited by 35
- 2024ToolBeHonest: A Multi-level Hallucination Diagnostic Benchmark for Tool-Augmented Large Language Modelscited by 25
- 2026InfiAgent: An Infinite-Horizon Framework for General-Purpose Autonomous Agentscited by 9
- 2026OdysseyArena: Benchmarking Large Language Models For Long-Horizon, Active and Inductive Interactionscited by 6
- 2026Multi-Agent Video Recommenders: Evolution, Patterns, and Open Challengescited by 6
- 2026Zero-shot Cross-domain Knowledge Distillation: A Case study on YouTube Musiccited by 4
- 2026MM-THEBench: Do Reasoning MLLMs Think Reasonably?cited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Consistency as a Testable Property: Statistical Methods to Evaluate AI Agent Reliability
- 2026Overseeing Agents Without Constant Oversight: Challenges and Opportunities
- 2026Confident and Wrong: Silent Semantic Failures in Coding Agents
- 2026Trace-Level Analysis of Information Contamination in Multi-Agent Systems
- 2026A Sober Look at Agentic Misalignment in Automated Workflows
- 2026Do AI Agents Know When a Task Is Simple? Toward Complexity-Aware Reasoning and Execution
- 2026Loud Failures, Quiet Failures: Fault Detection and Recovery in Tool-Using Language Model Agents
- 2026LayerRAG-Bench: A Cross-Layer Reliability Benchmark for Agentic Retrieval-Augmented Generation