Hydra-0: Action Flow for Generalist World Modeling and Control
On the map: World models → Embodied and robot world models
Abstract (arXiv)
We introduce Hydra-0, a generalist world model conditioned on action flow, which represents robot actions as pixel motion. This shared visual interface enables generalist world modeling and control by learning action consequences across embodiments, tasks, environments, and video-generation backbones. Our best configuration achieves 90.4% lower robot-motion error and 60.2% lower object-motion error than our action-conditioned baseline, while supporting zero-shot composition and data-efficient adaptation. On the RoboLab benchmark, Hydra-0 achieves a Pearson correlation of r=0.96 between replayed and reference success rates. Finally, we uncover an emergent inverse mode of this interface: a world action model that predicts compatible robot motion from desired object flow transferred from a human demonstration. A trained action head maps the resulting latent features to executable actions without requiring task-specific expert robot demonstrations. Together, these results demonstrate the potential of action flow as a shared control interface connecting heterogeneous training data, open-loop policy evaluation, and robot control.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 13 of its 45 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
13 of 45 references.
Closest ancestors · 5
Same direction, newest first
- 2026Robot-Factored World Models via Robot Rendering24 Jul
- 2026BridgeV2W: Bridging Video Generation Models to Embodied World Models via Embodiment Masks3 Feb
- 2025Scalable Policy Evaluation with Video World Models14 Nov
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
- 2024FLIP: Flow-Centric Generative Planning as General-Purpose Manipulation World Model11 Dec
Other references · 8
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 433
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 50
- 2026AdaJEPA: An Adaptive Latent World Modelcited by 20
- 2026Scalable Behavior Cloning with Open Data, Training, and Evaluationcited by 10
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution
- 2026Motubrain: An Advanced World Action Model for Robot Control
- 2026GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026OpenWAM: An Open Framework for Composable World-Action Models
- 2026ZimaBlue: Evolving Generalizable World Action Models through Scalable Video Pre-training
- 2026JoyAI-RA 0.5: Scaling Robot Manipulation Learning via Dual Action Alignment
- 2026Native Action-Prior Learning from Videos for World Action Models