MemCoT: Test-Time Scaling through Memory-Driven Chain-of-Thought
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
Large Language Models (LLMs) still suffer from severe hallucinations and catastrophic forgetting during causal reasoning over massive, fragmented long contexts. Existing memory mechanisms typically treat retrieval as a static, single-step passive matching process, leading to severe semantic dilution and contextual fragmentation. To overcome these fundamental bottlenecks, we propose MemCoT, a test-time memory scaling framework that redefines the reasoning process by transforming long-context reasoning into an iterative, stateful information search. MemCoT introduces a multi-view long-term memory perception module that enables Zoom-In evidence localization and Zoom-Out contextual expansion, allowing the model to first identify where relevant evidence resides and then reconstruct the surrounding causal structure necessary for reasoning. In addition, MemCoT employs a task-conditioned dual short-term memory system composed of semantic state memory and episodic trajectory memory. This short-term memory records historical search decisions and dynamically guides query decomposition and pruning across iterations. Empirical evaluations demonstrate that MemCoT establishes a state-of-the-art performance. Empowered by MemCoT, several open- and closed-source models achieve SOTA performance on the LoCoMo benchmark and LongMemEval-S benchmark.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 11 of its 50 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
11 of 50 references.
Closest ancestors · 1
Same direction, newest first
Other references · 10
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 183
- 2025G-Memory: Tracing Hierarchical Memory for Multi-Agent Systemscited by 122
- 2025What Deserves Memory: Adaptive Memory Distillation for LLM Agentscited by 48
- 2025A Simple Yet Strong Baseline for Long-Term Conversational Memory of LLM Agentscited by 21
- 2026InfMem: Learning System-2 Memory Control for Long-Context Agentcited by 9
- 2025Evaluating Long-Term Memory for Long-Context Question Answeringcited by 8
- 2025Preliminary Explorations with GPT-4o(mni) Native Image Generationcited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Test-Time Memory Construction
- 2026MemRetriever: Learning to Search, Reflect, and Retrieve from Long-Term Memory ↗
- 2026Recall What Is Missing: Composing Evidence from Long-Term Agent Memory
- 2026MemSearch-o1: Empowering Large Language Models with Reasoning-Aligned Memory Growth in Agentic Search
- 2026MemDuet: Learning Dual-Process Memory for Long-Context Reasoning
- 2026RecaLLM: Addressing the Lost-in-Thought Phenomenon with Explicit In-Context Retrieval
- 2026MemGuard: Preventing Memory Contamination in Long-Term Memory-Augmented Large Language Models
- 2024MemLong: Memory-Augmented Retrieval for Long Text Modeling