Failure Recovery via Belief Updates and World Modeling for Long-Horizon Agents
On the map: World models → World models for language agents
also in 1 more
Abstract (arXiv)
Long-horizon agents often struggle to recover from failures whose causes lie several steps earlier, beyond what local reflection or backtracking can resolve. We introduce BELIEFWEAVER, a framework that combines persistent evidence across attempts with prospective reasoning over repair directions. It maintains a relational belief state over frontiers, attempts, observations, and checkpoints. Execution evidence updates related frontier priorities across attempts and rollback, while diagnostic evidence gates execution. An implicit world model (IWM) evaluates repair hypotheses, predicts progress, and identifies relations among frontiers to guide exploration. We further distill these recurring IWM reasoning components into a 9B student through supervised fine-tuning and on-policy distillation (OPD). Across three terminal-based benchmarks, BELIEFWEAVER improves aggregate final score by 5.1 percentage points over native Terminus-2 continuation, with positive trends in exploration efficiency. The distilled 9B student improves final score by 9.8 percentage points over the reported native baseline while reducing estimated teacher API cost by 54.8% relative to the matched teacher. These results show that persistent evidence and prospective reasoning can improve recovery in long-horizon agent tasks while substantially reducing reliance on teacher-model inference.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 35 of its 46 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
35 of 46 references.
Closest ancestors · 10
Same direction, newest first
- 2026Scaling Automatic Research Agents via World Models12 Aug
- 2026Tycho: Active Abstraction with Programmatic World Models for ARC-AGI-330 Jul
- 2026Qwen-AgentWorld: Language World Models for General Agents23 Jun
- 2026PatchWorld: Gradient-Free Optimization of Executable World Models for Agent Environments29 May
- 2026Executable World Models for ARC-AGI-3 in the Era of Coding Agents6 May
- 2024Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents10 Nov
- 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agents9 Oct
- 2024Agent Planning with World Knowledge Model23 May
- 2024WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment19 Feb
- 2023Reasoning with Language Model is Planning with World Model24 May
Other references · 25
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2026SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learningcited by 278
- 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 148
- 2026Long-Horizon-Terminal-Bench: Testing the Limits of Agents on Long-Horizon Terminal Tasks with Dense Reward-Based Gradingcited by 31
- 2026MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discoverycited by 28
13 more
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinementcited by 22
- 2026Co-Evolving LLM Decision and Skill Bank Agents for Long-Horizon Taskscited by 15
- 2024Generative Factor Chaining: Coordinated Manipulation with Diffusion-based Factor Graphcited by 14
- 2026FALAT: Tracing Failures in LLM Agent Trajectories via Dependency-Guided Searchcited by 12
- 2026RE-TRAC: REcursive TRAjectory Compression for Deep Search Agentscited by 11
- 2026Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agentscited by 11
- 2026AgentRewind: Recoverable Execution for Long-Horizon LLM Agentscited by 7
- 2026Learning from the Irrecoverable: Error-Localized Policy Optimization for Tool-Integrated LLM Reasoningcited by 6
- 2026Argus: Evidence Assembly for Scalable Deep Research Agentscited by 6
- 2026Multi-agent Collaboration with State Managementcited by 6
- 2026SciNav: A General Agent Framework for Scientific Coding Taskscited by 3
- 2026Diagnosing Search Behavior and Failure Modes in Long-Horizon Search Agentscited by 2
- 2026Decoupling Exploration and Policy Optimization: Uncertainty Guided Tree Search for Hard Explorationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Measuring Harness-Induced Belief Divergence in Multi-Step LLM Agents
- 2026Sentry: Learning to Recover from LLM Agent Failures at Test Time
- 2025ReflexGrad: Within-Episode Failure Recovery in LLM Agents via Progress-Gated Dual-Process Routing
- 2026When Harnesses Lose the Signal: Causal Evaluation of Recovery in LLM Agents
- 2026Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States
- 2026Bayesian-Agent: Posterior-Guided Skill Evolution Across LLM Agent Harnesses
- 2026StateWise: Diagnosing and Repairing Persistent Operational State Before Agent Actions
- 2026Interlock: From Local Correctness to Task Completion in Long-Horizon Agents