Procedural Memory Is Not All You Need: Bridging Cognitive Gaps in LLM-Based Agents
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Large Language Models (LLMs) represent a landmark achievement in Artificial Intelligence (AI), demonstrating unprecedented proficiency in procedural tasks such as text generation, code completion, and conversational coherence. These capabilities stem from their architecture, which mirrors human procedural memory -- the brain's ability to automate repetitive, pattern-driven tasks through practice. However, as LLMs are increasingly deployed in real-world applications, it becomes impossible to ignore their limitations operating in complex, unpredictable environments. This paper argues that LLMs, while transformative, are fundamentally constrained by their reliance on procedural memory. To create agents capable of navigating ``wicked'' learning environments -- where rules shift, feedback is ambiguous, and novelty is the norm -- we must augment LLMs with semantic memory and associative learning systems. By adopting a modular architecture that decouples these cognitive functions, we can bridge the gap between narrow procedural expertise and the adaptive intelligence required for real-world problem-solving.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 10 of its 29 references that are in the map. First posted on arXiv 6 May 2025.
Builds on
10 of 29 references.
References · 10
- 2017Attention Is All You Needcited by 59,932
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2024Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Modelscited by 71
- 2024On Limitations of the Transformer Architecturecited by 63
- 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 58
- 2021Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matterscited by 25
- 2024Sliding-Window Thompson Sampling for Non-Stationary Settingscited by 15
- 2024Reinforcement Learning for Aligning Large Language Models Agents with Interactive Environments: Quantifying and Mitigating Prompt Overfittingcited by 4
Built on by
Citing papers per year: 2025: 5; 2026: 4.
9 papers.
- 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 160
- 2026ADAM: A Systematic Data Extraction Attack on Agent Memory via Adaptive Queryingcited by 5
- 2025A Benchmark for Procedural Memory Retrieval in Language Agentscited by 4
- 2025The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architecturescited by 3
- 2026M2: Dual-Memory Augmentation for Long-Horizon Web Agents via Trajectory Summarization and Insight Retrievalcited by 3
- 2025Towards autonomous normative multi-agent systems for Human-AI software engineering teamscited by 2
- 2026CraniMem: Cranial Inspired Gated and Bounded Memory for Agentic Systemscited by 1
- 2025Behavioural Effects of Agentic Messaging: A Case Study on a Financial Service Applicationcited by 0
- 2026Sustained Impact of Agentic Personalisation in Marketing: A Longitudinal Case Studycited by 0
- 2026ADAM: A Systematic Data Extraction Attack on Agent Memory via Adaptive Querying10 Apr 2026
- 2026Sustained Impact of Agentic Personalisation in Marketing: A Longitudinal Case Study9 Apr 2026
- 2026CraniMem: Cranial Inspired Gated and Bounded Memory for Agentic Systems3 Mar 2026
- 2026M2: Dual-Memory Augmentation for Long-Horizon Web Agents via Trajectory Summarization and Insight Retrieval28 Feb 2026
- 2025Behavioural Effects of Agentic Messaging: A Case Study on a Financial Service Application19 Dec 2025
- 2025Towards autonomous normative multi-agent systems for Human-AI software engineering teams2 Dec 2025
- 2025A Benchmark for Procedural Memory Retrieval in Language Agents21 Nov 2025
- 2025The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures6 Oct 2025
- 2025MIRIX: Multi-Agent Memory System for LLM-Based Agents10 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
- 2026Understanding Large Language Models
- 2026AdMem: Advanced Memory for Task-solving Agents
- 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics
- 2023Empowering Working Memory for Large Language Model Agents
- 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers
- 2026Computer Environments Elicit General Agentic Intelligence in LLMs
- 2025Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory