Reading Right, Acting Wrong: Diagnosing Decision Failures of System One Models in Agent Loops
Not on the map. Why?
Abstract (arXiv)
System One models choose an agent's next action by scoring a supplied set of options in a single pass. This makes them fast and cheap, but when they choose wrongly there is nothing to inspect: did the model misread what the agent has seen, or read it correctly and still act wrongly? We answer behaviorally. On a frozen benchmark of agent decision states from simulated environments, customer-service policies, tool use, web navigation and coding, we pair every next-action question with factual probes about the same state, each answered independently. Across seventeen fast systems and a reasoning model, the answer is consistent: most wrong actions follow correct reading, and the more accurate a system, the more of its errors take this form. These errors are not noise; they gather on the same states across systems of every kind. Where the probed facts provably determine the action, models that read every fact still fail to combine them, and their own answers, composed by code, repair the failure. On real states, what is missing is often not a fact but the next sub-goal.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 70 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
41 of 70 references.
References · 41
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 1,006
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
29 more
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
- 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 386
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
- 2020ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Languagecited by 324
- 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 312
- 2018TextWorld: A Learning Environment for Text-based Gamescited by 310
- 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agentscited by 288
- 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 244
- 2024BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystackcited by 215
- 2019CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Textcited by 162
- 2024BALROG: Benchmarking Agentic LLM and VLM Reasoning On Gamescited by 146
- 2025AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectoriescited by 108
- 2023BoardgameQA: A Dataset for Natural Language Reasoning with Contradictory Informationcited by 44
- 2025When2Call: When (not) to Call Toolscited by 42
- 2025LLMs are Greedy Agents: Effects of RL Fine-tuning on Decision-Making Abilitiescited by 41
- 2022CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negationcited by 39
- 2026JEV-as-a-Judge: Accept When Confident, Escalate When Unsurecited by 30
- 2025AgentRM: Enhancing Agent Generalization with Reward Modelingcited by 27
- 2026Rethinking Failure Attribution in Multi-Agent Systems: A Multi-Perspective Benchmark and Evaluationcited by 24
- 2023ScoNe: Benchmarking Negation Reasoning in Language Models With Fine-Tuning and In-Context Learningcited by 18
- 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?cited by 18
- 2025TALES: Text Adventure Learning Environment Suitecited by 11
- 2026Why Do LLMs Struggle in Strategic Play? Broken Links Between Observations, Beliefs, and Actionscited by 3
- 2024Probing the Capacity of Language Model Agents to Operationalize Disparate Experiential Context Despite Distractioncited by 2
- 2026STOCKTAKE: Measuring the Gap Between Perception and Action in LLM Agents with a Fair Oraclecited by 1
- 2026Memory Control Signals Emerge Before Action in Long Horizon Agentscited by 1
- 2026StateComp: Learning When to Compress History in Long Horizon Agentscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026System Switch: When Should a Fast Decision Model Stop and Think?
- 2026Agents Are Systems, Not Models: Rethinking Agentic Evaluation
- 2026Loud Failures, Quiet Failures: Fault Detection and Recovery in Tool-Using Language Model Agents
- 2025SABER: Small Actions, Big Errors -- Safeguarding Mutating Steps in LLM Agents
- 2026INTENT-AS-A-TOOL Makes it Easy to Track Agentic Misalignment
- 2026When Small Models Are Right for Wrong Reasons: Process Verification for Trustworthy Agents
- 2026Sentry: Learning to Recover from LLM Agent Failures at Test Time
- 2026Doing What They Say, Not What They Reason: Locating the Faithfulness Gap in LLM Agents