mlsanityData to 14 Oct 2026

Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution

arXiv 2608.28995 ↗First posted 29 Aug 2026cs.RO cs.CVcited by 0

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

World models let robots imagine possible futures, but exploiting this capability for real-time planning is bottlenecked by a representation misalignment: generative models and planners operate on decoupled manifolds, requiring computationally expensive decoding of every candidate back to the high-dimensional observation space for evaluation. In this paper, we present Hydra, a discrete World Action Model that tackles this by establishing a unified latent manifold over visual states, physical poses, and control actions. By compressing this manifold through modality-specific Vector-Quantized bottlenecks, Hydra yields discrete vocabularies of kinodynamic intents and visual states. This enables Discrete Latent Planning (DLP), where candidates are sampled directly from the shared manifold and ranked by a Kinematic-Perceptual Cost within the discrete latent space. To bridge discrete planning with the continuous commands required for physical actuation, Hydra pairs DLP with conditional Flow Matching to map selected intents to smooth execution trajectories. Evaluated on two physical robotic platforms, Hydra outperforms state-of-the-art navigation world models in goal-directed planning, while matching or exceeding the closed-loop execution capabilities of leading reactive navigation policies.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 40 of its 90 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

40 of 90 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026World Guidance: World Modeling in Condition Space for Action Generation25 Feb
  2. 2026World Action Models are Zero-shot Policies17 Feb
  3. 2026GigaBrain-0.5M*: a VLA That Learns From World Model-Based Reinforcement Learning12 Feb
  4. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb
  5. 2025WorldPlanner: Monte Carlo Tree Search and MPC with Action-Conditioned Visual World Models4 Nov
  6. 2025Generative World Modelling for Humanoids: 1X World Model Challenge Technical Report8 Oct
  7. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
  8. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr

Other references · 32

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2022Classifier-Free Diffusion Guidancecited by 5,847
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  6. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  7. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  8. 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 378
  9. 2022Transformers are Sample-Efficient World Modelscited by 328
  10. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  11. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
  12. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
20 more
  1. 2025Unified Video Action Modelcited by 205
  2. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  3. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
  4. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  5. 2026Advancing Open-source World Modelscited by 154
  6. 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
  7. 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 127
  8. 2015Model Predictive Path Integral Control using Covariance Variable Importance Samplingcited by 124
  9. 2025Learning from Reward-Free Offline Data: A Case for Planning with Latent Dynamics Modelscited by 89
  10. 2022Understanding and Improving the Role of Projection Head in Self-Supervised Learningcited by 36
  11. 2023A Control-Centric Benchmark for Video Predictioncited by 25
  12. 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generationcited by 18
  13. 2025Self-Supervised Representation Learning with Joint Embedding Predictive Architecture for Automotive LiDAR Object Detectioncited by 13
  14. 2025Pixel Motion Diffusion is What We Need for Robot Controlcited by 7
  15. 2026NavWM: A Unified Navigation World Model for Foresight-Driven Planningcited by 5
  16. 2026VQ-Style: Disentangling Style and Content in Motion with Residual Quantized Representationscited by 3
  17. 2026LeFlow: Generative Latent Flow Planning for World Modelscited by 3
  18. 2025VertiFormer: A Data-Efficient Multi-Task Transformer for Off-Road Robot Mobilitycited by 2
  19. 2026DreamFlow: Local Navigation Beyond Observation via Conditional Flow Matching in the Latent Spacecited by 1
  20. 2026The Geometry of Projection Heads: Conditioning, Invariance, and Collapsecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Hydra-0: Action Flow for Generalist World Modeling and Control
  2. 2026NavWAM: A Navigation World Action Model for Goal-Conditioned Visual Navigation
  3. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  4. 2025Efficient Image-Goal Navigation with Representative Latent World Model
  5. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
  6. 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement
  7. 2026World-Action Models for Robot Learning and Control: A Survey
  8. 2026MARS: Systematic Multi-Level Acceleration for World Action Models