Advancing Multimodal Agent Reasoning with Long-Term Neuro-Symbolic Memory
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Recent advances in large language models have driven the emergence of intelligent agents operating in open-world, multimodal environments. To support long-term reasoning, such agents are typically equipped with external memory systems. However, most existing multimodal agent memories rely primarily on neural representations and vector-based retrieval, which are well-suited for inductive, intuitive reasoning but fundamentally limited in supporting analytical, deductive reasoning critical for real-world decision making. To address this limitation, we propose NS-Mem, a long-term neuro-symbolic memory framework designed to advance multimodal agent reasoning by integrating neural memory with explicit symbolic structures and rules. Specifically, NS-Mem is operated around three core components of a memory system: (1) a three-layer memory architecture that consists episodic layer, semantic layer and logic rule layer, (2) a memory construction and maintenance mechanism implemented by SK-Gen that automatically consolidates structured knowledge from accumulated multimodal experiences and incrementally updates both neural representations and symbolic rules, and (3) a hybrid memory retrieval mechanism that combines similarity-based search with deterministic symbolic query functions to support structured reasoning. Experiments on real-world multimodal reasoning benchmarks demonstrate that Neural-Symbolic Memory achieves an average 4.35% improvement in overall reasoning accuracy over pure neural memory systems, with gains of up to 12.5% on constrained reasoning queries, validating the effectiveness of NS-Mem.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 13 of its 49 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
13 of 49 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2022Using cognitive psychology to understand GPT-3cited by 389
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 239
- 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 160
- 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 141
- 2023SCM: Enhancing Large Language Model with Self-Controlled Memory Frameworkcited by 98
- 2024AIOS: LLM Agent Operating Systemcited by 94
- 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
- 2023MM-VID: Advancing Video Understanding with GPT-4V(ision)cited by 82
- 2024AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent Systemcited by 53
- 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
- 2024From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Modelscited by 42
- 2024MemLong: Memory-Augmented Retrieval for Long Text Modelingcited by 11
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Task-Focused Memorization for Multimodal Agentscited by 1
- 2026Replan, Repair, or Edit? A Unified Empirical Evaluation of Travel Agents for Itinerary Revision under Resource Disruptionscited by 1
- 2026Interpretable Column Annotation with LLM-Symbolized Decision Process Materializationcited by 0
- 2026RRM: Experience-Driven Reflective Retrieval Memory for Long-Horizon Multimodal Reasoningcited by 0
- 2026Calibrating Post-Training Feature Shifts for LLM Data Contamination Detectioncited by 0
- 2026Replan, Repair, or Edit? A Unified Empirical Evaluation of Travel Agents for Itinerary Revision under Resource Disruptions17 Sep 2026
- 2026Calibrating Post-Training Feature Shifts for LLM Data Contamination Detection11 Aug 2026
- 2026RRM: Experience-Driven Reflective Retrieval Memory for Long-Horizon Multimodal Reasoning30 Jul 2026
- 2026Interpretable Column Annotation with LLM-Symbolized Decision Process Materialization28 Jul 2026
- 2026Task-Focused Memorization for Multimodal Agents29 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026MemWeaver: Weaving Hybrid Memories for Traceable Long-Horizon Agentic Reasoning
- 2025MemVerse: Multimodal Memory for Lifelong Learning Agents
- 2026BMAM: Brain-inspired Multi-Agent Memory Framework
- 2025Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents
- 2026Dual-Grained Agent Memory and Shapley Context Attribution for Multimodal Agentic Learner
- 2025Agent-ScanKit: Unraveling Memory and Reasoning of Multimodal Agents via Sensitivity Perturbations
- 2026The AI Hippocampus: How Far are We From Human Memory?
- 2026SF-AMS: Strategic Forgetting for Structured Memory in LLM Agent