mlsanityData to 7 Oct 2026

HiMe: Hierarchical Embodied Memory for Long-Horizon Vision-Language-Action Control

arXiv 2607.03449 ↗First posted 3 Jul 2026cs.RO cs.AIcited by 1

On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA

Abstract (arXiv)

Current Vision-Language-Action (VLA) models excel at robotic manipulation but often struggle with non-Markovian tasks requiring long-term memory and reasoning due to their reliance on immediate observations. Existing solutions face a ''frequency-competence paradox,'' where stronger reasoning models are too slow for real-time control, while faster models lack sufficient reasoning capabilities. To resolve this architectural misalignment, we propose HiMe, a Hierarchical Embodied Memory framework that decouples embodied intelligence into a high-frequency Executor for execution, a Sentry for working memory, and a Planner for long-term strategy. We also introduce a dynamic knowledge system based on cross-modal semantic schemas and active management mechanisms, allowing robots to maintain memory plasticity through ''Add, Update, and Delete'' operations. This hierarchical design effectively balances the conflict between real-time execution and slow thinking planning, significantly improving success rates in long-horizon tasks. Experiments demonstrate that this approach not only outperforms flat memory baselines but also exhibits the novel ability to self-correct its internal knowledge based on human preferences.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 24 of its 26 references that are in the map. First posted on arXiv 3 Jul 2026.

Builds on

24 of 26 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulation12 Nov
  2. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulation26 Aug

Other references · 22

  1. 2024GPT-4o System Cardcited by 4,467
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  6. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  7. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  8. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  9. 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 220
  10. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
  11. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
  12. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
10 more
  1. 2023SCM: Enhancing Large Language Model with Self-Controlled Memory Frameworkcited by 98
  2. 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
  3. 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 83
  4. 2025SAM2Act: Integrating Visual Foundation Model with A Memory Architecture for Robotic Manipulationcited by 58
  5. 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoningcited by 50
  6. 2024From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Controlcited by 34
  7. 2025MemVerse: Multimodal Memory for Lifelong Learning Agentscited by 31
  8. 2025Learning Long-Context Diffusion Policies via Past-Token Predictioncited by 28
  9. 2020Vision-Dialog Navigation by Exploring Cross-modal Memorycited by 23
  10. 2025RoboOmni: Proactive Robot Manipulation in Omni-modal Contextcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Unmasking the Illusion of Embodied Reasoning in Vision-Language-Action Models
  2. 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
  3. 2026Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflection
  4. 2025FindingDory: A Benchmark to Evaluate Memory in Embodied Agents
  5. 2025Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective
  6. 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation
  7. 2026Key-Gram: Extensible World Knowledge for Embodied Manipulation
  8. 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training