MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligence
Not on the map. Why?
Abstract (arXiv)
General-purpose robot control requires models to understand task intent, identify where to interact, capture how the scene evolves, and generate precise actions. Vision-language-action models provide strong semantic priors but typically do not explicitly model scene dynamics, while world-action models couple visual prediction with control without necessarily exposing the task-relevant semantic and spatial structure needed for fine-grained manipulation. We present MachEmbodied-U0 (ME-U0), a unified embodied foundation model connecting understanding and generation experts through a Mixture-of-Transformers architecture. Subtask prediction and affordance grounding guide joint visual-dynamics and action generation via flow matching. Visual dynamics encompass future RGB, depth, surface normals, and optical flow, providing complementary supervision for appearance, geometry, and motion. Multi-rate Rotary Position Encoding (MRPE) aligns visual dynamics with fine-grained control. We pretrain ME-U0 on approximately 4,200 hours of curated demonstrations from robotic datasets and egocentric datasets. Using only the supervision natively available in each downstream benchmark, ME-U0 achieves an average score of 17.66 on the RoboDojo simulation benchmark and average success rates of 99.0% and 82.5% on LIBERO and LIBERO-Plus, respectively. We additionally validate ME-U0 on real-world robotic manipulation tasks, demonstrating its effectiveness beyond simulation. Without corresponding downstream supervision, ME-U0 further demonstrates zero-shot subtask prediction, affordance grounding, and visual dynamics on simulated and real-world observations. Overall, ME-U0 combines competitive downstream control performance with transferable task-grounding and visual-dynamics capabilities across simulation and the real world.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 74 of its 81 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
74 of 81 references.
References · 74
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023Visual Instruction Tuningcited by 7,792
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
38 more
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2026World Action Models are Zero-shot Policiescited by 411
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
- 2026Causal World Modeling for Robot Controlcited by 289
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2025Motus: A Unified Latent Action World Modelcited by 231
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 129
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 72
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 68
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoisingcited by 65
- 2026Motubrain: An Advanced World Action Model for Robot Controlcited by 54
- 2026EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the Worldcited by 49
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 47
- 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policiescited by 46
50 most cited of 74 All 74 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodiments
- 2026GEM: Generative Supervision Helps Embodied Intelligence
- 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning
- 2025UniJEPA: Enhancing Robot Policy via Unified Continuous and Discrete Representation Learning
- 2025Look, Zoom, Understand: The Robotic Eyeball for Embodied Perception
- 2026EWAM: Emergent Depth-Wise Specialization in a Unified Embodied Model -- From Semantic Understanding through Visual Foresight to Action