HiMe: Hierarchical Embodied Memory for Long-Horizon Vision-Language-Action Control
On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA
Abstract (arXiv)
Current Vision-Language-Action (VLA) models excel at robotic manipulation but often struggle with non-Markovian tasks requiring long-term memory and reasoning due to their reliance on immediate observations. Existing solutions face a ''frequency-competence paradox,'' where stronger reasoning models are too slow for real-time control, while faster models lack sufficient reasoning capabilities. To resolve this architectural misalignment, we propose HiMe, a Hierarchical Embodied Memory framework that decouples embodied intelligence into a high-frequency Executor for execution, a Sentry for working memory, and a Planner for long-term strategy. We also introduce a dynamic knowledge system based on cross-modal semantic schemas and active management mechanisms, allowing robots to maintain memory plasticity through ''Add, Update, and Delete'' operations. This hierarchical design effectively balances the conflict between real-time execution and slow thinking planning, significantly improving success rates in long-horizon tasks. Experiments demonstrate that this approach not only outperforms flat memory baselines but also exhibits the novel ability to self-correct its internal knowledge based on human preferences.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 24 of its 26 references that are in the map. First posted on arXiv 3 Jul 2026.
Builds on
24 of 26 references.
Closest ancestors · 2
Same direction, newest first
- 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulation12 Nov
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulation26 Aug
Other references · 22
- 2024GPT-4o System Cardcited by 4,467
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 220
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
- 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
- 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
10 more
- 2023SCM: Enhancing Large Language Model with Self-Controlled Memory Frameworkcited by 98
- 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
- 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 83
- 2025SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulationcited by 58
- 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoningcited by 50
- 2024From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Controlcited by 34
- 2025MemVerse: Multimodal Memory for Lifelong Learning Agentscited by 31
- 2025Learning Long-Context Diffusion Policies via Past-Token Predictioncited by 28
- 2020Vision-Dialog Navigation by Exploring Cross-modal Memorycited by 23
- 2025RoboOmni: Proactive Robot Manipulation in Omni-modal Contextcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Unmasking the Illusion of Embodied Reasoning in Vision-Language-Action Models
- 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
- 2026Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflection
- 2025FindingDory: A Benchmark to Evaluate Memory in Embodied Agents
- 2025Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation
- 2026Key-Gram: Extensible World Knowledge for Embodied Manipulation
- 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training