mlsanityData to 7 Oct 2026

HiVLA: A Visual-Grounded-Centric Hierarchical Embodied Manipulation System

arXiv 2604.14125 ↗First posted 15 Apr 2026cs.CV cs.AI cs.ROcited by 7

On the map: LLM reasoning → Spatial and embodied reasoning

also in 3 more
Abstract (arXiv)

While end-to-end Vision-Language-Action (VLA) models offer a promising paradigm for robotic manipulation, fine-tuning them on narrow control data often compromises the profound reasoning capabilities inherited from their base Vision-Language Models (VLMs). To resolve this fundamental trade-off, we propose HiVLA, a visual-grounded-centric hierarchical framework that explicitly decouples high-level semantic planning from low-level motor control. In high-level part, a VLM planner first performs task decomposition and visual grounding to generate structured plans, comprising a subtask instruction and a precise target bounding box. Then, to translate this plan into physical actions, we introduce a flow-matching Diffusion Transformer (DiT) action expert in low-level part equipped with a novel cascaded cross-attention mechanism. This design sequentially fuses global context, high-resolution object-centric crops and skill semantics, enabling the DiT to focus purely on robust execution. Our decoupled architecture preserves the VLM's zero-shot reasoning while allowing independent improvement of both components. Extensive experiments in simulation and the real world demonstrate that HiVLA significantly outperforms state-of-the-art end-to-end baselines, particularly excelling in long-horizon skill composition and the fine-grained manipulation of small objects in cluttered scenes.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 38 of its 42 references that are in the map. First posted on arXiv 15 Apr 2026.

Builds on

38 of 42 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Actions as Language: Fine-Tuning VLMs into VLAs Without Catastrophic Forgetting26 Sep
  2. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  3. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb

Other references · 35

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 2022Scalable Diffusion Models with Transformerscited by 5,931
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  7. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  8. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  9. 2025Qwen3-VL Technical Reportcited by 2,534
  10. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  11. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  12. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
23 more
  1. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  2. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  3. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
  4. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  5. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
  6. 2024RT-H: Action Hierarchies Using Languagecited by 204
  7. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
  8. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
  9. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
  10. 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 116
  11. 2025GR-3 Technical Reportcited by 110
  12. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
  13. 2025DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Graspingcited by 87
  14. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
  15. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
  16. 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulationcited by 71
  17. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 66
  18. 2025MemER: Scaling Up Memory for Robot Control via Experience Retrievalcited by 64
  19. 2025RoboGround: Robotic Manipulation with Grounded Vision-Language Priorscited by 50
  20. 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructionscited by 50
  21. 2025H-RDT: Human Manipulation Enhanced Bimanual Robotic Manipulationcited by 41
  22. 20253D CAVLA: Leveraging Depth and 3D Context to Generalize Vision Language Action Models for Unseen Taskscited by 30
  23. 2025Scaling Vision Pre-Training to 4K Resolutioncited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ThinkingVLA: Interleaved Vision and Language Reasoning for Robotic Manipulation
  2. 2025ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulation
  3. 2026Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflection
  4. 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training
  5. 2026Scaling World Model for Hierarchical Manipulation Policies
  6. 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulation
  7. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
  8. 2026Libra-VLA: Achieving Learning Equilibrium via Asynchronous Coarse-to-Fine Dual-System