Remember When It Matters: Proactive Memory Agent for Long-Horizon Agents
Not on the map. Why?
Abstract (arXiv)
In long-horizon tasks, decision-relevant state is often scattered across an expanding trajectory, while the action agent must surface it and act. As trajectories grow, task requirements, environment facts, prior attempts, diagnoses, and open subgoals can be buried in the context window or pushed beyond it, failing to influence decisions when needed. We call this failure mode "behavioral state decay". We study memory as an active intervention mechanism rather than passive retrieval. A separate memory agent runs alongside an unmodified action agent, updating a structured memory bank from the recent trajectory and deciding whether to inject a memory-grounded reminder or remain silent. The module is plug-and-play with frontier action agents and existing agent harnesses. Across Terminal-Bench 2.0 and τ2-Bench, it improves pass@1 for both weaker and stronger action agents, with gains of +8.3 pp on Terminal-Bench and +6.8 pp on τ2-Bench. Ablations show that selective intervention outperforms passive bank exposure, always-on injection, advisor-only guidance, and general retrieval. As an early step toward open-weight memory policies, we train Qwen3.5-27B on SETA using SFT and GRPO, improving validation reward and achieving partial transfer to Terminal-Bench.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 18 of its 22 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
18 of 22 references.
References · 18
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
6 more
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 515
- 2023Augmenting Language Models with Long-Term Memorycited by 186
- 2025Scaling Long-Horizon LLM Agent via Context-Foldingcited by 136
- 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Taskscited by 62
- 2025How to Train Your Advisor: Steering Black-Box LLMs with Advisor Modelscited by 20
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026Sigma-Mem: An Online Reliability Memory for LLM-based Multi-Agent Systemscited by 1
- 2026CORAL: An LLM-Native Harness for Production Recommender Systemscited by 1
- 2026Root-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent Failurescited by 0
- 2026Stable Geometry with Divergent Task Evidence for Efficient Long-Horizon Agent Compressioncited by 0
- 2026Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agentscited by 0
- 2026Dude, Where's My State? Execution Information Requirements for Stateful Agentscited by 0
- 2026Beyond Skill Evolution: Self-Evolving Context Management Policies for Long-Horizon Agent Harnessescited by 0
- 2026When Should Agents Check External State? Budgeting Observations for Stored Intentionscited by 0
- 2026ALER: Adaptive Learnable Experience Rewriting for Reinforcement Learningcited by 0
- 2026RunningTab: Direct Workspace Interaction with Environment-Side Tabscited by 0
- 2026RunningTab: Direct Workspace Interaction with Environment-Side Tabs7 Oct 2026
- 2026ALER: Adaptive Learnable Experience Rewriting for Reinforcement Learning30 Sep 2026
- 2026When Should Agents Check External State? Budgeting Observations for Stored Intentions29 Sep 2026
- 2026Beyond Skill Evolution: Self-Evolving Context Management Policies for Long-Horizon Agent Harnesses28 Sep 2026
- 2026Dude, Where's My State? Execution Information Requirements for Stateful Agents26 Sep 2026
- 2026Just-in-Time Memory: Learning to Curate Task-Adaptive Memory for LLM Agents23 Sep 2026
- 2026Stable Geometry with Divergent Task Evidence for Efficient Long-Horizon Agent Compression23 Sep 2026
- 2026Root-Cause Attribution Is a Search Problem: Continual Search for Long-Horizon Agent Failures11 Sep 2026
- 2026CORAL: An LLM-Native Harness for Production Recommender Systems2 Sep 2026
- 2026Sigma-Mem: An Online Reliability Memory for LLM-based Multi-Agent Systems30 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026When to Forget: A Memory Governance Primitive
- 2026Oblivion: Self-Adaptive Agentic Memory Control through Decay-Driven Activation
- 2026Memory Control Signals Emerge Before Action in Long Horizon Agents
- 2026MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks
- 2026The Epistemics of Agent Memory: Measuring, and Governing, the Consolidation Decision in Long-Horizon LLM Agents
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent
- 2026Exploring Cross-Scenario Generality of Agentic Memory Systems: Diagnostics and a Strong Baseline
- 2026RaMem: Contextual Reinstatement for Long-term Agentic Memory