mlsanityData to 7 Oct 2026

MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligence

arXiv 2609.25627 ↗First posted 22 Sep 2026cs.RO cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

General-purpose robot control requires models to understand task intent, identify where to interact, capture how the scene evolves, and generate precise actions. Vision-language-action models provide strong semantic priors but typically do not explicitly model scene dynamics, while world-action models couple visual prediction with control without necessarily exposing the task-relevant semantic and spatial structure needed for fine-grained manipulation. We present MachEmbodied-U0 (ME-U0), a unified embodied foundation model connecting understanding and generation experts through a Mixture-of-Transformers architecture. Subtask prediction and affordance grounding guide joint visual-dynamics and action generation via flow matching. Visual dynamics encompass future RGB, depth, surface normals, and optical flow, providing complementary supervision for appearance, geometry, and motion. Multi-rate Rotary Position Encoding (MRPE) aligns visual dynamics with fine-grained control. We pretrain ME-U0 on approximately 4,200 hours of curated demonstrations from robotic datasets and egocentric datasets. Using only the supervision natively available in each downstream benchmark, ME-U0 achieves an average score of 17.66 on the RoboDojo simulation benchmark and average success rates of 99.0% and 82.5% on LIBERO and LIBERO-Plus, respectively. We additionally validate ME-U0 on real-world robotic manipulation tasks, demonstrating its effectiveness beyond simulation. Without corresponding downstream supervision, ME-U0 further demonstrates zero-shot subtask prediction, affordance grounding, and visual dynamics on simulated and real-world observations. Overall, ME-U0 combines competitive downstream control performance with transferable task-grounding and visual-dynamics capabilities across simulation and the real world.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 74 of its 81 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

74 of 81 references.

References · 74

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  9. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  11. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  12. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
38 more
  1. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  2. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  3. 2025SAM 3: Segment Anything with Conceptscited by 835
  4. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  5. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  6. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  7. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  8. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  9. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  10. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
  11. 2026World Action Models are Zero-shot Policiescited by 411
  12. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  13. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  14. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
  15. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
  16. 2026Causal World Modeling for Robot Controlcited by 289
  17. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  18. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  19. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
  20. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  21. 2025Motus: A Unified Latent Action World Modelcited by 231
  22. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  23. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 193
  24. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
  25. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
  26. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 129
  27. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
  28. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
  29. 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
  30. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
  31. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
  32. 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 72
  33. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 68
  34. 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoisingcited by 65
  35. 2026Motubrain: An Advanced World Action Model for Robot Controlcited by 54
  36. 2026EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the Worldcited by 49
  37. 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 47
  38. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policiescited by 46

50 most cited of 74 All 74 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  2. 2026RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation
  3. 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodiments
  4. 2026GEM: Generative Supervision Helps Embodied Intelligence
  5. 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning
  6. 2025UniJEPA: Enhancing Robot Policy via Unified Continuous and Discrete Representation Learning
  7. 2025Look, Zoom, Understand: The Robotic Eyeball for Embodied Perception
  8. 2026EWAM: Emergent Depth-Wise Specialization in a Unified Embodied Model -- From Semantic Understanding through Visual Foresight to Action