UNITAS: A 3D-Native World Action Model for Embodied Manipulation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World action models (WAMs) aim to answer a coupled physical question: given a task instruction, what motion should the robot execute, and how will that motion change the surrounding world? Most existing WAMs build on pretrained video generators and represent world evolution through images or visual latents. Robotic interaction, however, takes place in metric three-dimensional space, while images are view-dependent projections whose pixel distances do not directly encode physical distances. We introduce UNITAS, to our knowledge the first 3D-native world action model that unifies observations, actions, and scene dynamics in a shared metric 3D frame within each interaction, using a common representation across robot embodiments and human hands. Action flow represents human hands and robot grippers as 3D point trajectories, while scene flow describes scene-point displacements conditioned on these trajectories. World-aligned 3D positional embeddings ground visual tokens with or without depth input, and a physical-time trajectory tokenizer encodes each point trajectory as one token anchored at its current 3D position. This interface supports both direct action execution and action-conditioned scene prediction. With 1.7B parameters, UNITAS achieves the best action-conditioned scene prediction on RoboTwin among the compared methods, with up to 49% lower displacement errors than PointWorld, and state-of-the-art manipulation success, including 99.8% on LIBERO and an average of 85% across real-world tasks. The code is available at https://github.com/DexForce/UNITAS.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. First posted on arXiv 8 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PointWAM: 3D World Action Modeling for Dexterous Robotic Manipulation
- 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation
- 2026MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulation
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026SkeleWAM: Skeleton World-Action Modeling for Efficient Robotic Manipulation
- 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data
- 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokens
- 2026DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulation