ActiveMem: Dynamic Latent Memory Trees for Long-Horizon Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Large Language Model (LLM) agents increasingly rely on external memory to support long-horizon reasoning and decision making. Existing memory systems typically retrieve historical trajectories or summaries as independent context fragments, overlooking the procedural dependencies underlying multi-step execution. As memory scales, such flat retrieval introduces context fragmentation and cross-task interference, leading to structurally inconsistent reasoning trajectories. We propose ActiveMem, a hierarchical memory framework that recursively organizes agent experiences into dependency-aware latent execution trees. ActiveMem abstracts trajectories into reusable subtask nodes while explicitly preserving execution transitions, enabling coherent reasoning-path retrieval conditioned on the current execution state. To support continual adaptation, ActiveMem further learns dynamic memory expansion, retrieval, and pruning policies through reinforcement learning. Experiments across various agent benchmarks demonstrate that ActiveMem consistently improves task completion, reasoning stability, and memory efficiency over existing memory-based agents. Moreover, ActiveMem enables compact open-weight models to achieve competitive performance with substantially larger proprietary systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 37 of its 57 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
37 of 57 references.
Closest ancestors · 3
Same direction, newest first
- 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agents29 Sep
- 2025A-MEM: Agentic Memory for LLM Agents17 Feb
- 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model18 Aug
Other references · 34
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
22 more
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 876
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
- 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 195
- 2025Beyond Ten Turns: Unlocking Long-Horizon Agentic Search with Large-Scale Asynchronous RLcited by 150
- 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 145
- 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 126
- 2025KodCode: A Diverse, Challenging, and Verifiable Synthetic Dataset for Codingcited by 119
- 2025Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Toolscited by 106
- 2025LightThinker: Thinking Step-by-Step Compressioncited by 104
- 2025WebExplorer: Explore and Evolve for Training Long-Horizon Web Agentscited by 92
- 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learningcited by 72
- 2025WideSearch: Benchmarking Agentic Broad Info-Seekingcited by 69
- 2025From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agentscited by 51
- 2025Scaling LLM Multi-turn RL with End-to-end Summarization-based Context Managementcited by 51
- 2026REDSearcher: A Scalable and Cost-Efficient Framework for Long-Horizon Search Agentscited by 49
- 2025NewtonBench: Benchmarking Generalizable Scientific Law Discovery in LLM Agentscited by 36
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ActiveMem: Distributed Active Memory for Long-Horizon LLM Reasoning
- 2026AdMem: Advanced Memory for Task-solving Agents
- 2026Weighted Memory Tree: Remembering What Matters for Long-Horizon LLM Agents
- 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent
- 2026PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning
- 2026MemWeaver: Weaving Hybrid Memories for Traceable Long-Horizon Agentic Reasoning
- 2026Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents
- 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agents