Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision
On the map: LLM reasoning → Spatial and embodied reasoning
also in 2 more
Abstract (arXiv)
Cross-embodiment transfer in vision-language-action (VLA) models remains challenging because low-level state and action spaces differ fundamentally across robot platforms. We observe that the high-level cognitive process underlying manipulation, including scene perception, object identification, task planning, and sub-task decomposition, is largely shared across embodiments. Based on this observation, we present ZR-0, a 2.6 billion parameter end-to-end VLA model that uses dense Embodied Chain-of-Thought (ECoT) supervision to align cross-embodiment representations within the vision-language model (VLM). ZR-0 adopts a dual-stream architecture: a pre-trained VLM (System 2) generates structured ECoT reasoning during training, while a Diffusion Transformer-based action expert (System 1) produces continuous action chunks via flow matching. The two components are coupled through cross-attention, with an attention mask that restricts the action expert to input prompt features only, enabling ECoT generation to be entirely skipped at inference without any performance loss. ZR-0 is pre-trained on ProcCorpus-60M, a large-scale dataset comprising approximately 60 million frames (approximately 1,000 hours) from over 400K trajectories, with dense ECoT annotations covering 96.8% of all frames. We evaluate ZR-0 on three simulation benchmarks spanning single-arm (LIBERO), bimanual (RoboTwin 2.0), and humanoid (RoboCasa GR-1 Tabletop) embodiments, as well as real-world experiments on the xArm platform, demonstrating strong performance across all settings. Code and model checkpoints are available at https://github.com/RUCKBReasoning/ZR-0.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 34 of its 65 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
34 of 65 references.
Closest ancestors · 7
Same direction, newest first
- 2026MolmoAct2: Action Reasoning Models for Real-world Deployment4 May
- 2025DeepThinkVLA: Enhancing Reasoning Capability of Vision-Language-Action Models31 Oct
- 2025Vlaser: Vision-Language-Action Model with Synergistic Embodied Reasoning13 Oct
- 2025EO-1: An Open Unified Embodied Foundation Model for General Robot Control28 Aug
- 2025MolmoAct: Action Reasoning Models that can Reason in Space11 Aug
- 2025ChatVLA-2: Vision-Language-Action Model with Open-World Embodied Reasoning from Pretrained Knowledge28 May
- 2025Training Strategies for Efficient Embodied Reasoning13 May
Other references · 27
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2025GR-3 Technical Reportcited by 110
15 more
- 2025OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoningcited by 105
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026A Pragmatic VLA Foundation Modelcited by 97
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 86
- 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 77
- 2025Igniting VLMs toward the Embodied Spacecited by 53
- 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulationcited by 48
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 47
- 2025NORA-1.5: A Vision-Language-Action Model Trained using World Model- and Action-based Preference Rewardscited by 26
- 2026JoyAI-RA 0.1: A Foundation Model for Robotic Autonomycited by 21
- 2026A Systematic Study of Data Modalities and Strategies for Co-training Large Behavior Models for Robot Manipulationcited by 20
- 2026VP-VLA: Visual Prompting as an Interface for Vision-Language-Action Modelscited by 17
- 2026ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulationcited by 8
- 2026Green-VLA: Staged Vision-Language-Action Model for Generalist Robotscited by 6
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modelingcited by 12
- 2026MobileVLA-R1 2.0: RL-Enhanced Reasoning for Mobile Robot Controlcited by 1
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulationcited by 0
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
- 2026CrossSafe: Towards Cross-Embodiment Latent Safety Filterscited by 0
- 2026CrossSafe: Towards Cross-Embodiment Latent Safety Filters24 Sep 2026
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM22 Sep 2026
- 2026MobileVLA-R1 2.0: RL-Enhanced Reasoning for Mobile Robot Control5 Sep 2026
- 2026One Policy, Many Embodiments: Unified Camera-Centric Action Geometry Pre-training for Heterogeneous Embodied Manipulation26 Aug 2026
- 2026JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling10 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation
- 2026Learning Action Priors for Cross-embodiment Robot Manipulation
- 2025Embodiment Transfer Learning for Vision-Language-Action Models
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodiments
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
- 2026X-DiffVLA: X-Embodied Diffusion Action Heads for Vision-Language-Action Models
- 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines