mlsanityData to 7 Oct 2026

ImagineUAV: Aerial Vision-Language Navigation via World-Action Modeling and Kinodynamic Planning

arXiv 2606.01205 ↗First posted 31 May 2026cs.ROcited by 6

On the map: World models → World models for navigation

Abstract (arXiv)

Vision-language navigation (VLN) for UAVs demands grounding free-form instructions into 6-DoF flight under partial observability. While Vision-Language-Action (VLA) models excel at semantic reasoning, they suffer from brittleness due to geometric inconsistency and dynamics mismatch. To address this, we propose ImagineUAV, an imagination-driven framework leveraging cascaded world-action modeling. Instead of direct regression, ImagineUAV employs a latent video diffusion model to generate instruction-conditioned future observations, explicitly imagining environmental evolution, from which 6-DoF motions are inferred via an action extractor. A kinodynamic planner then refines these estimates into collision-free trajectories. Additionally, a step-distilled inference pipeline ensures real-time execution. With only 1.3B parameters, ImagineUAV outperforms prior VLN and VLA baselines on benchmarks and real-world flights, validating the practicality of imagination-driven aerial navigation.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 12 of its 23 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

12 of 23 references.

References · 12

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  4. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  5. 2026World Action Models are Zero-shot Policiescited by 411
  6. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
  7. 2025HunyuanVideo 1.5 Technical Reportcited by 148
  8. 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 72
  9. 2026World Action Models: The Next Frontier in Embodied AIcited by 46
  10. 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 43
  11. 2026NavDreamer: Video Models as Zero-Shot 3D Navigatorscited by 9
  12. 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026WorldFly: A World-Model-Based Vision-Language-Action Model for UAV Navigation
  2. 2026WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigation
  3. 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
  4. 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
  5. 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigation
  6. 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodology
  7. 2026AirForesight: Current-to-Future Spatial Map Imagination with Cross-Space Planning Consistency for UAV-VLN ↗
  8. 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models