mlsanityData to 7 Oct 2026

Advancing Multimodal Agent Reasoning with Long-Term Neuro-Symbolic Memory

arXiv 2603.15280 ↗First posted 16 Mar 2026cs.AIcited by 5

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Recent advances in large language models have driven the emergence of intelligent agents operating in open-world, multimodal environments. To support long-term reasoning, such agents are typically equipped with external memory systems. However, most existing multimodal agent memories rely primarily on neural representations and vector-based retrieval, which are well-suited for inductive, intuitive reasoning but fundamentally limited in supporting analytical, deductive reasoning critical for real-world decision making. To address this limitation, we propose NS-Mem, a long-term neuro-symbolic memory framework designed to advance multimodal agent reasoning by integrating neural memory with explicit symbolic structures and rules. Specifically, NS-Mem is operated around three core components of a memory system: (1) a three-layer memory architecture that consists episodic layer, semantic layer and logic rule layer, (2) a memory construction and maintenance mechanism implemented by SK-Gen that automatically consolidates structured knowledge from accumulated multimodal experiences and incrementally updates both neural representations and symbolic rules, and (3) a hybrid memory retrieval mechanism that combines similarity-based search with deterministic symbolic query functions to support structured reasoning. Experiments on real-world multimodal reasoning benchmarks demonstrate that Neural-Symbolic Memory achieves an average 4.35% improvement in overall reasoning accuracy over pure neural memory systems, with gains of up to 12.5% on constrained reasoning queries, validating the effectiveness of NS-Mem.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 13 of its 49 references that are in the map. First posted on arXiv 16 Mar 2026.

Builds on

13 of 49 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023On the Planning Abilities of Large Language Models : A Critical Investigation25 May

Other references · 12

  1. 2022Using cognitive psychology to understand GPT-3cited by 389
  2. 2022Emergent Analogical Reasoning in Large Language Modelscited by 239
  3. 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 160
  4. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
  5. 2023SCM: Enhancing Large Language Model with Self-Controlled Memory Frameworkcited by 98
  6. 2024AIOS: LLM Agent Operating Systemcited by 94
  7. 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
  8. 2023MM-VID: Advancing Video Understanding with GPT-4V(ision)cited by 82
  9. 2024AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent Systemcited by 53
  10. 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
  11. 2024From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Modelscited by 42
  12. 2024MemLong: Memory-Augmented Retrieval for Long Text Modelingcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MemWeaver: Weaving Hybrid Memories for Traceable Long-Horizon Agentic Reasoning
  2. 2025MemVerse: Multimodal Memory for Lifelong Learning Agents
  3. 2026BMAM: Brain-inspired Multi-Agent Memory Framework
  4. 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents
  5. 2026Dual-Grained Agent Memory and Shapley Context Attribution for Multimodal Agentic Learner
  6. 2025Agent-ScanKit: Unraveling Memory and Reasoning of Multimodal Agents via Sensitivity Perturbations
  7. 2026The AI Hippocampus: How Far are We From Human Memory?
  8. 2026SF-AMS: Strategic Forgetting for Structured Memory in LLM Agent