Rollback the World, Keep the Reflection: Rollback-Induced Reflection for Long-Horizon LLM Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Large language model (LLM) agents increasingly tackle long-horizon tasks through multi-step environment interaction, yet a single erroneous action can alter subsequent states and observations, causing errors to compound over time. Existing methods either correct the context without repairing altered environment states or restore earlier states while discarding useful experience, making it difficult to both eliminate failure conditions and avoid repeating past mistakes. We argue that reliable recovery should instead be treated as a rollback-boundary control problem that jointly determines when to intervene, where to resume, and what information should survive recovery. Based on this view, we propose Rollback-Induced Reflection (RIR), a unified recovery framework that restores execution to a selected prior state while carrying forward reusable knowledge distilled from the abandoned trajectory to guide subsequent decisions. We further characterize recovery through a unified operator over rollback depth and retained memory, providing a general view of state restoration and knowledge retention. Experiments on three long-horizon benchmarks show that RIR consistently improves average task performance across multiple LLM backbones, with structured reflection memory preserving useful experience and selective rollback enabling efficient recovery.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 28 of its 30 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
28 of 30 references.
Closest ancestors · 3
Same direction, newest first
- 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agents5 Jan
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems9 Jun
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
Other references · 25
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 574
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 327
13 more
- 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 240
- 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?cited by 116
- 2024AutoGuide: Automated Generation and Selection of Context-Aware Guidelines for Large Language Model Agentscited by 74
- 2025ReflAct: World-Grounded Decision Making in LLM Agents via Goal-State Reflectioncited by 31
- 2025BacktrackAgent: Enhancing GUI Agent with Error Detection and Backtracking Mechanismcited by 25
- 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollbackcited by 17
- 2025AgentScope 1.0: A Developer-Centric Framework for Building Agentic Applicationscited by 17
- 2025WebRollback: Enhancing Web Agents with Explicit Rollback Mechanismscited by 15
- 2025Generator-Assistant Stepwise Rollback Framework for Large Language Model Agentcited by 14
- 2026DART: Semantic Recoverability for Structured Tool Agentscited by 10
- 2026AgentRewind: Recoverable Execution for Long-Horizon LLM Agentscited by 7
- 2026Speculative Rollback Correction for Quality-Diverse Web Agent Imitationcited by 2
- 2026Agent-Enhanced Heterogeneous Graph RAG for Academic Question Answeringcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ChronoMem: Version Control and Semantic Rollback for Large Language Model Agent Memory
- 2026LoongReflect: Boosting Long-Horizon Reflection in Search Agents via Global Perspective Distillation
- 2026Travel Back To Move Forward: Retrospective Exploration and Evolving for Long Horizon Agents
- 2026From Faulty Memories to Corrected Actions: Dependency-Guided Rollback Repair for Memory-Augmented Agents
- 2026Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States
- 2026When Harnesses Lose the Signal: Causal Evaluation of Recovery in LLM Agents
- 2026Verifiable Memory: Learning Unified Memory Management with Local and Global Verifiers for Large Language Model Agents
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent