Analytic Concept-Centric Memory for Agentic Embodied Manipulation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Long-horizon embodied manipulation requires agents to remember persistent objects, track changing scene states, and reuse prior interaction knowledge. However, existing agent memories are often stored as unstructured histories or embedding-based records, making it difficult to retrieve manipulation-relevant object parts, physical states, action effects, and executable skills. We propose an analytic concept-centric memory framework for agentic embodied manipulation. Our memory organizes experience around structured analytic concepts, where objects are represented by semantic parts, parametric templates, grounded poses, affordances, and manipulation states. It further connects object and scene memories with transition memory for action-induced state changes and skill memory for template-grounded and policy-grounded execution. At runtime, the agent performs structured coarse-to-fine retrieval to identify relevant objects, states, transitions, and skills, supporting state-consistent reasoning and skill reuse. Experiments on memory-dependent manipulation, articulated-object generalization, real-world memory evaluation, and ablations show that our approach improves task completion, retrieval accuracy, object re-identification, and cross-object skill generalization over unstructured and embedding-based memory baselines.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 32 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
23 of 32 references.
Closest ancestors · 2
Same direction, newest first
- 2025Agentic Robot: A Brain-Inspired Framework for Vision-Language-Action Models in Embodied Agents29 May
- 2024KARMA: Augmenting Embodied AI Agents with Long-and-short Term Memory Systems23 Sep
Other references · 21
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2020Point Transformercited by 1,470
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2025Memory in the Age of AI Agentscited by 303
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 162
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 156
9 more
- 2019Scene Memory Transformer for Embodied Agents in Long-Horizon Taskscited by 107
- 2024ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigationcited by 67
- 2025MemER: Scaling Up Memory for Robot Control via Experience Retrievalcited by 67
- 2024A3VLM: Actionable Articulation-Aware Vision Language Modelcited by 33
- 2026ReMem-VLA: Empowering Vision-Language-Action Model with Memory via Dual-Level Recurrent Queriescited by 29
- 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learningcited by 21
- 2026LiLo-VLA: Compositional Long-Horizon Manipulation via Linked Object-Centric Policiescited by 14
- 2024ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualizationcited by 6
- 2024Arti-PG: A Toolbox for Procedurally Synthesizing Large-Scale and Diverse Articulated Objects with Rich Annotationscited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective
- 2026REMM: Revisable Embodied Memory for Manipulation ↗
- 2026What Should Embodied Agents Remember? Benchmarking and Evaluating Memory Modality for Embodied Agents
- 2025Embodied Agents Meet Personalization: Investigating Challenges and Solutions Through the Lens of Memory Utilization
- 2024Retrieval-Augmented Embodied Agents
- 2026SkillMemo: Expert-guided Skill Memory Framework for Compositional Embodied Manipulation
- 2026Video2Skill: From Streaming Experience to Reusable Embodied Skills
- 2026EmbodiedMemory-Bench: Benchmarking Embodied Memory for Long-Horizon Embodied Tasks