Remember by Asking: Retrieval-Induced Memory Evolution for LLM Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Long-term memory is essential for language agents to maintain coherent and effective behavior over extended, multi-session interactions. Existing memory systems mainly use retrieval at read time, while write-time memory formation still relies on direct extraction or compression. However, when future information needs are unknown, compressing an entire interaction in one pass can overlook locally important details that may matter later. To this end, we introduce RIME, a retrieval-induced memory framework that shifts memory construction from monolithic compression toward evidence-centered integration. RIME uses generic self-questions to retrieve focused dialogue evidence and grounds memory formation in both the retrieved evidence and relevant historical memories, which are jointly reconciled into an evolving memory bank with temporal and provenance information. At inference time, compressed memory serves as the primary rather than the sole source of evidence: when it cannot support an answer, RIME retrieves relevant source dialogue together with its local context to recover information omitted during memory formation, without resorting to full-history processing. Extensive experiments on LoCoMo with Qwen3-235B-A22B and GPT-5.6 Sol show that RIME consistently achieves the best performance across all three quality metrics among the compared methods, while requiring substantially fewer query-time LLM tokens.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 15 of its 18 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
15 of 18 references.
Closest ancestors · 9
Same direction, newest first
- 2026Retrieval-Driven Memory Reconsolidation for Long-Term LLM Agents13 Sep
- 2026SAGE: A Novelty Gate for Efficient Memory Evolution in Agentic LLMs29 May
- 2026D-Mem: A Dual-Process Memory System for LLM Agents19 Mar
- 2026FadeMem: Biologically-Inspired Forgetting for Efficient Agent Memory26 Jan
- 2026SimpleMem: Efficient Lifelong Memory for LLM Agents5 Jan
- 2025What Deserves Memory: Adaptive Memory Distillation for LLM Agents5 Aug
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
- 2025A-MEM: Agentic Memory for LLM Agents17 Feb
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agents27 Feb
Other references · 6
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 163
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LeanMem: Simple and Efficient Long-Term Memory for LLM Agents
- 2026MGRetrieval: Memory-Guided Reflective Retrieval for Long-Term Dialogue Agents
- 2026Beyond Memory Construction: Rethinking Memory Access for LLM-based Conversational Agents
- 2026HiMem: Hierarchical Long-Term Memory for LLM Long-Horizon Agents
- 2026When Does Memory Help? A Cost-Aware Evaluation of Long-Term Memory in Tool-Using LLM Agents
- 2024On the Structural Memory of LLM Agents
- 2026LazyMem: Retrieve Broadly, Construct Selectively for Efficient Long-Term Agent Memory
- 2026EdgeMem: LLM-Free Agent Memory Construction and Retrieval via Evidence-Preserving Multi-Anchor Hypergraph