DM0: An Embodied-Native Vision-Language-Action Model towards Physical AI
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Moving beyond the traditional paradigm of adapting internet-pretrained models to physical tasks, we present DM0, an Embodied-Native Vision-Language-Action (VLA) framework designed for Physical AI. Unlike approaches that treat physical grounding as a fine-tuning afterthought, DM0 unifies embodied manipulation and navigation by learning from heterogeneous data sources from the onset. Our methodology follows a comprehensive three-stage pipeline: Pretraining, Mid-Training, and Post-Training. First, we conduct large-scale unified pretraining on the Vision-Language Model (VLM) using diverse corpora--seamlessly integrating web text, autonomous driving scenarios, and embodied interaction logs-to jointly acquire semantic knowledge and physical priors. Subsequently, we build a flow-matching action expert atop the VLM. To reconcile high-level reasoning with low-level control, DM0 employs a hybrid training strategy: for embodied data, gradients from the action expert are not backpropagated to the VLM to preserve generalized representations, while the VLM remains trainable on non-embodied data. Furthermore, we introduce an Embodied Spatial Scaffolding strategy to construct spatial Chain-of-Thought (CoT) reasoning, effectively constraining the action solution space. Experiments on the RoboChallenge benchmark demonstrate that DM0 achieves state-of-the-art performance in both Specialist and Generalist settings on Table30.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 41 of its 53 references that are in the map. First posted on arXiv 16 Feb 2026.
Builds on
41 of 53 references.
Closest ancestors · 10
Same direction, newest first
- 2025Dexbotic: Open-Source Vision-Language-Action Toolbox27 Oct
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model22 Oct
- 2025LLaDA-VLA: Vision Language Diffusion Action Models8 Sep
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better29 May
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
- 2025Beyond Sight: Finetuning Generalist Robot Policies with Heterogeneous Sensors via Language Grounding8 Jan
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 31
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 553
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
- 2021OCR-free Document Understanding Transformercited by 400
19 more
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 315
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2025PaddleOCR 3.0 Technical Reportcited by 136
- 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 126
- 2022Syntax-Aware Network for Handwritten Mathematical Expression Recognitioncited by 68
- 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 68
- 2024Focus Anywhere for Fine-grained Multi-page Document Understandingcited by 62
- 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 54
- 2023Merlin:Empowering Multimodal LLMs with Foresight Mindscited by 46
- 2025Step-GUI Technical Reportcited by 38
- 2024Insight Over Sight: Exploring the Vision-Knowledge Conflicts in Multimodal LLMscited by 37
- 2025Unhackable Temporal Rewarding for Scalable Video MLLMscited by 33
- 2026CLAP: Contrastive Latent Action Pretraining for Learning Vision-Language-Action Models from Human Videoscited by 27
- 2022CCMB: A Large-scale Chinese Cross-modal Benchmarkcited by 21
- 2024DocFusion: A Unified Framework for Document Parsing Taskscited by 5
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policiescited by 35
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Modelcited by 13
- 2026Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflectioncited by 9
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Modelcited by 8
- 2026World2Act: Latent Action Post-Training from World Model Dynamicscited by 7
- 2026VAG: Dual-Stream Video-Action Generation for Embodied Data Synthesiscited by 4
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026GesVLA: Gesture-Aware Vision-Language-Action Model Embedded Representationscited by 2
- 2026Action with Visual Primitivescited by 1
- 2026TuringViT: Making SOTA Vision Transformers Accessible to Allcited by 1
- 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modelingcited by 0
- 2026What to Attend, What to Keep: Skill-Conditioned Visuotactile Representation with Progress-Guided Event Memorycited by 0
- 2026What to Attend, What to Keep: Skill-Conditioned Visuotactile Representation with Progress-Guided Event Memory29 Sep 2026
- 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modeling26 Sep 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policies5 Jul 2026
- 2026TuringViT: Making SOTA Vision Transformers Accessible to All23 Jun 2026
- 2026GesVLA: Gesture-Aware Vision-Language-Action Model Embedded Representations21 May 2026
- 2026Action with Visual Primitives21 May 2026
- 2026Evo-Depth: A Lightweight Depth-Enhanced Vision-Language-Action Model14 May 2026
- 2026Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflection15 Apr 2026
- 2026VAG: Dual-Stream Video-Action Generation for Embodied Data Synthesis10 Apr 2026
- 2026A1: A Fully Transparent Open-Source, Adaptive and Efficient Truncated Vision-Language-Action Model7 Apr 2026
- 2026World2Act: Latent Action Post-Training from World Model Dynamics11 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
- 2026EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training
- 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
- 2024A Survey on Vision-Language-Action Models for Embodied AI
- 2026Guava: Distilling Frontier VLMs into a Compact Agent through a Robotic Manipulation Harness
- 2025Igniting VLMs toward the Embodied Space
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodiments
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing