mlsanityData to 7 Oct 2026

Procedural Memory Is Not All You Need: Bridging Cognitive Gaps in LLM-Based Agents

arXiv 2505.03434 ↗First posted 6 May 2025cs.AI cs.LGcited by 9

On the map: LLM agents and tool use → Agent memory systems

Abstract (arXiv)

Large Language Models (LLMs) represent a landmark achievement in Artificial Intelligence (AI), demonstrating unprecedented proficiency in procedural tasks such as text generation, code completion, and conversational coherence. These capabilities stem from their architecture, which mirrors human procedural memory -- the brain's ability to automate repetitive, pattern-driven tasks through practice. However, as LLMs are increasingly deployed in real-world applications, it becomes impossible to ignore their limitations operating in complex, unpredictable environments. This paper argues that LLMs, while transformative, are fundamentally constrained by their reliance on procedural memory. To create agents capable of navigating ``wicked'' learning environments -- where rules shift, feedback is ambiguous, and novelty is the norm -- we must augment LLMs with semantic memory and associative learning systems. By adopting a modular architecture that decouples these cognitive functions, we can bridge the gap between narrow procedural expertise and the adaptive intelligence required for real-world problem-solving.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 10 of its 29 references that are in the map. First posted on arXiv 6 May 2025.

Builds on

10 of 29 references.

References · 10

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
  5. 2024Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Modelscited by 71
  6. 2024On Limitations of the Transformer Architecturecited by 63
  7. 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 58
  8. 2021Causal Decision Making and Causal Effect Estimation Are Not the Same... and Why It Matterscited by 25
  9. 2024Sliding-Window Thompson Sampling for Non-Stationary Settingscited by 15
  10. 2024Reinforcement Learning for Aligning Large Language Models Agents with Interactive Environments: Quantifying and Mitigating Prompt Overfittingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 4.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
  2. 2026Understanding Large Language Models
  3. 2026AdMem: Advanced Memory for Task-solving Agents
  4. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics
  5. 2023Empowering Working Memory for Large Language Model Agents
  6. 2026Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers
  7. 2026Computer Environments Elicit General Agentic Intelligence in LLMs
  8. 2025Intrinsic Memory Agents: Heterogeneous Multi-Agent LLM Systems through Structured Contextual Memory