ImagineUAV: Aerial Vision-Language Navigation via World-Action Modeling and Kinodynamic Planning
On the map: World models → World models for navigation
Abstract (arXiv)
Vision-language navigation (VLN) for UAVs demands grounding free-form instructions into 6-DoF flight under partial observability. While Vision-Language-Action (VLA) models excel at semantic reasoning, they suffer from brittleness due to geometric inconsistency and dynamics mismatch. To address this, we propose ImagineUAV, an imagination-driven framework leveraging cascaded world-action modeling. Instead of direct regression, ImagineUAV employs a latent video diffusion model to generate instruction-conditioned future observations, explicitly imagining environmental evolution, from which 6-DoF motions are inferred via an action extractor. A kinodynamic planner then refines these estimates into collision-free trajectories. Additionally, a step-distilled inference pipeline ensures real-time execution. With only 1.3B parameters, ImagineUAV outperforms prior VLN and VLA baselines on benchmarks and real-world flights, validating the practicality of imagination-driven aerial navigation.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 12 of its 23 references that are in the map. First posted on arXiv 31 May 2026.
Builds on
12 of 23 references.
References · 12
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2026World Action Models are Zero-shot Policiescited by 411
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2025HunyuanVideo 1.5 Technical Reportcited by 148
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 72
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 43
- 2026NavDreamer: Video Models as Zero-Shot 3D Navigatorscited by 9
- 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulationcited by 5
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigationcited by 2
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigationcited by 0
- 2026Map the Possibilities: Spatial Belief Fields for Language-Goal Aerial Navigationcited by 0
- 2026Visual Cue Guided Video Planning for Generalizable Robot Navigationcited by 0
- 2026UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agentscited by 0
- 2026DiffWAM: A Fast and Efficient Navigation World Action Modelcited by 0
- 2026DiffWAM: A Fast and Efficient Navigation World Action Model30 Sep 2026
- 2026UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agents16 Sep 2026
- 2026Visual Cue Guided Video Planning for Generalizable Robot Navigation15 Sep 2026
- 2026Map the Possibilities: Spatial Belief Fields for Language-Goal Aerial Navigation5 Sep 2026
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigation12 Aug 2026
- 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigation6 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026WorldFly: A World-Model-Based Vision-Language-Action Model for UAV Navigation
- 2026WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigation
- 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
- 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
- 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigation
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodology
- 2026AirForesight: Current-to-Future Spatial Map Imagination with Cross-Space Planning Consistency for UAV-VLN ↗
- 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models