mlsanityData to 14 Oct 2026

UniW(A)M: A Unified Mixture-of-Experts Framework for World and World-Action Models

arXiv 2610.18697 ↗First posted 13 Oct 2026cs.RO cs.AI cs.CVcited by 0

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

World models (WMs) and world-action models (WAMs) focus on future world prediction and executable action generation, respectively. Although these models learn shared physical dynamics and interaction semantics from embodied trajectories, they are typically trained in isolation, which restricts knowledge reuse between prediction and control. The central challenge is therefore to develop a unified learning framework that shares these dynamics while preserving the distinct modeling capabilities required by each paradigm. We propose UniW(A)M, a mixture-of-experts world-(action) model built upon diffusion Transformers that unifies action-conditioned world modeling and diverse WAM variants. Shared experts capture common dynamics, while atomic capability experts are reused across interfaces so that each interface keeps its own conditional pathway. At deployment, a plug-in adaptive interface router (PAIR) learns from a small subset of target-task chunk scenarios to select a suitable WAM interface for each execution chunk, balancing task success and execution efficiency while keeping the backbone frozen. We evaluate UniW(A)M on LIBERO, RoboTwin 2.0, and three real-world manipulation tasks, where it achieves 88.3% average real-world success versus 76.7% for the strongest baseline. On WorldArena, it leads action-conditioned world modeling on all three tasks. AC-WM co-training contributes to action generation on every action interface and PAIR raises OOD success from 63.3% to 76.7%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 34 of its 38 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

34 of 38 references.

Closest ancestors · 20

Same direction, newest first

  1. 2026World-Action Models for Robot Learning and Control: A Survey13 Sep
  2. 2026Riemann-1.0: An Embodied World Action Model for Physical AI27 Aug
  3. 2026Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learning25 Aug
  4. 2026GlanceWAM: Sparse Test-Time Imagination for World-Action Models25 Aug
  5. 2026FACT: Failure-Aware Causal Training for World-Action Models10 Aug
  6. 2026JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling10 Aug
  7. 2026WorldScape Policy 2.0: Empowering Steerable World Action Modeling with Reasoning-Augmented Memory and In-Context Learning21 Jul
  8. 2026Towards Predictive, Aligned, and Scalable Robot Learning13 Jul
  9. 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control4 Jul
  10. 2026World Action Models: A Survey18 Jun
  11. 2026World Action Models: The Next Frontier in Embodied AI12 May
  12. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos30 Apr
8 more
  1. 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
  2. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
  3. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  4. 2026World Action Models are Zero-shot Policies17 Feb
  5. 2026Causal World Modeling for Robot Control29 Jan
  6. 2025Motus: A Unified Latent Action World Model15 Dec
  7. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
  8. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr

Other references · 14

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  6. 2024Genie: Generative Interactive Environmentscited by 747
  7. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  8. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  9. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
  10. 2025Towards Unified World Models for Visual Navigation via Memory-Augmented Planning and Foresightcited by 14
  11. 2026Turning Video Models into Generalist Robot Policiescited by 12
  12. 2026Language-Conditioned World Modeling for Visual Navigationcited by 10
2 more
  1. 2026SimWAM: A Simple World Action Model for End-to-End Autonomous Drivingcited by 9
  2. 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planningcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026InternW0: A Foundational Physical World Model for Efficient Real-World Interactions
  2. 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligence
  3. 2026HarnessWAM: Bridging Prediction and Deliberation in World Action Models
  4. 2026OpenWAM: An Open Framework for Composable World-Action Models
  5. 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models
  6. 2026MARS: Systematic Multi-Level Acceleration for World Action Models
  7. 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
  8. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data