mlsanityData to 14 Oct 2026

Memory Control Signals Emerge Before Action in Long Horizon Agents

arXiv 2609.27286 ↗First posted 23 Sep 2026cs.AIcited by 1

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Long horizon language model agents continuously accumulate interaction history, increasing computational cost while making relevant information harder to preserve and reuse. Existing context management methods mainly focus on how to compress or retrieve history, but largely leave open whether the model itself already represents the need for these memory operations before they occur. We study the hidden state immediately before each agent action and find that compression and recall needs are already encoded in the model's internal representations. These signals cannot be explained by simple context length or interaction progress, and they exhibit distinct formation patterns across model depth. We further show that most memory decision information is preserved in a compact recent context, while selectively restored historical evidence complements the long range dependencies that recent context misses. Based on these findings, we propose Preaction Memory with Evidence Retrieval (PaMER), which combines state guided compression with external evidence retrieval. PaMER+ further introduces step level evidence selection to recover only the historical information required by the current task. Experiments on WorkBuddyBench, across multiple context management baselines and model backbones, show that our framework substantially reduces context consumption while maintaining competitive task performance.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 46 of its 50 references that are in the map. First posted on arXiv 23 Sep 2026.

Builds on

46 of 50 references.

Closest ancestors · 22

Same direction, newest first

  1. 2026HyMem: Hierarchical Context Management for Long-Horizon Agents via Information Isolation16 Aug
  2. 2026ACM: Agentic Context Management for Long Horizon Tasks26 Jul
  3. 2026Self-GC: Self-Governing Context for Long-Horizon LLM Agents1 Jul
  4. 2026LLM Agents Are Latent Context Managers: Eliciting Self-Managed Context via State Proprioception29 Jun
  5. 2026Self-Compacting Language Model Agents22 Jun
  6. 2026Learning What Not to Forget: Long-Horizon Agent Memory from a Few Kilobytes of Learning18 Jun
  7. 2026CoMem: Context Management with A Decoupled Long-Context Model29 May
  8. 2026SAM: State-Adaptive Memory for Long-Horizon Reasoning Agent23 May
  9. 2026HiGMem: A Hierarchical and LLM-Guided Memory System for Long-Term Conversational Agents20 Apr
  10. 2026HeLa-Mem: Hebbian Learning and Associative Memory for LLM Agents18 Apr
  11. 2026APEX-MEM: Agentic Semi-Structured Memory with Temporal Reasoning for Long-Term Conversational AI15 Apr
  12. 2026Lightweight LLM Agent Memory with Small Language Models9 Apr
10 more
  1. 2026AMA: Adaptive Memory via Multi-Agent Collaboration28 Jan
  2. 2026Active Context Compression: Autonomous Memory Management in LLM Agents12 Jan
  3. 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agents5 Jan
  4. 2025Preference-Aware Memory Update for Long-Term LLM Agents10 Oct
  5. 2025ACON: Optimizing Context Compression for Long-horizon LLM Agents1 Oct
  6. 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learning27 Aug
  7. 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents23 Jul
  8. 2025How Memory Management Impacts LLM Agents: An Empirical Study of Experience-Following Behavior21 May
  9. 2025TReMu: Towards Neuro-Symbolic Temporal Reasoning for LLM-Agents with Memory in Multi-Session Dialogues3 Feb
  10. 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb

Other references · 24

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  2. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  3. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  4. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  5. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  6. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
  7. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 1,040
  8. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  9. 2022Discovering Latent Knowledge in Language Models Without Supervisioncited by 767
  10. 2023The Internal State of an LLM Knows When It's Lyingcited by 659
  11. 2019Designing and Interpreting Probes with Control Taskscited by 640
  12. 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 587
12 more
  1. 2023Active Retrieval Augmented Generationcited by 516
  2. 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 453
  3. 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
  4. 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 348
  5. 2024Factual Confidence of LLMs: on Reliability and Robustness of Current Estimatorscited by 61
  6. 2026SWE-Pruner: Self-Adaptive Context Pruning for Coding Agentscited by 44
  7. 2025Context as a Tool: Context Management for Long-Horizon SWE-Agentscited by 43
  8. 2024Probing-RAG: Self-Probing to Guide Language Models in Selective Document Retrievalcited by 29
  9. 2025Sculptor: Empowering LLMs with Cognitive Agency via Active Context Managementcited by 18
  10. 2026MemBuilder: Reinforcing LLMs for Long-Term Memory Construction via Attributed Dense Rewardscited by 13
  11. 2026OCR-Memory: Optical Context Retrieval for Long-Horizon Agent Memorycited by 7
  12. 2026Tencent WorkBuddy Bench: A Multi-Domain Coding-Agent Benchmark with Contamination-Resistant Task Constructioncited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026StateComp: Learning When to Compress History in Long Horizon Agents
  2. 2026RaMem: Contextual Reinstatement for Long-term Agentic Memory
  3. 2026Beyond Memory: Harnessing Long-Horizon Agents with Explicit Belief States
  4. 2026When Can Agents Forget Their Reasoning? ICLR for Long-Horizon Agent Context Compression
  5. 2025Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Tasks
  6. 2026Verifiable Memory: Learning Unified Memory Management with Local and Global Verifiers for Large Language Model Agents
  7. 2026Remember When It Matters: Proactive Memory Agent for Long-Horizon Agents
  8. 2026PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning