WorldFly: A World-Model-Based Vision-Language-Action Model for UAV Navigation
On the map: World models → World models for navigation
Abstract (arXiv)
End-to-end Vision-Language-Action (VLA) models have shown promise in UAV navigation. However, existing approaches typically rely on historical observations to directly predict actions, often struggling in dense urban environments where severe occlusions and sharp turns result in drastic viewpoint transitions. We argue that the ability to "imagine" future states -- inherent in World Models -- is critical for robust decision-making under such partial observability. To address this, we construct a challenging Urban Canyon Traversal Benchmark, specifically designed to evaluate spatial understanding in scenarios characterized by severe occlusions and drastic viewpoint transitions. To this end, we propose WorldFly, a novel world-model-based VLA framework that employs a dual-branch coupled flow matching mechanism to jointly generate future video predictions and navigation actions, thereby explicitly guiding the agent's policy via spatial imagination. Extensive evaluations on our benchmark demonstrate that WorldFly outperforms other baselines, particularly in unseen environments, validating the effectiveness of integrating world models into embodied aerial agents.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 13 of its 14 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
13 of 14 references.
Closest ancestors · 1
Same direction, newest first
- 2024Navigation World Models4 Dec
Other references · 12
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2025Unified Video Action Modelcited by 205
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world modelcited by 186
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
- 2025Yume: An Interactive World Generation Modelcited by 81
- 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 64
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
- 2025UAV-Flow Colosseo: A Real-World Benchmark for Flying-on-a-Word UAV Imitation Learningcited by 31
- 2025RaceVLA: VLA-based Racing Drone Navigation with Human-like Behaviourcited by 23
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLNcited by 2
- 2026Map the Possibilities: Spatial Belief Fields for Language-Goal Aerial Navigationcited by 0
- 2026UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agentscited by 0
- 2026DroneWAM: Efficient World Action Model for Drone Visual Navigationcited by 0
- 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigationcited by 0
- 2026DiffWAM: A Fast and Efficient Navigation World Action Modelcited by 0
- 2026DiffWAM: A Fast and Efficient Navigation World Action Model30 Sep 2026
- 2026ForeFly: A Dual-Horizon World Action Model for Aerial Vision-Language Navigation27 Sep 2026
- 2026DroneWAM: Efficient World Action Model for Drone Visual Navigation27 Sep 2026
- 2026UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agents16 Sep 2026
- 2026Map the Possibilities: Spatial Belief Fields for Language-Goal Aerial Navigation5 Sep 2026
- 2026WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN7 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigation
- 2026ImagineUAV: Aerial Vision-Language Navigation via World-Action Modeling and Kinodynamic Planning
- 2026Vision-and-Language Navigation for UAVs: Progress, Challenges, and a Research Roadmap
- 2026AutoFly: Vision-Language-Action Model for UAV Autonomous Navigation in the Wild
- 2025Aerial World Model for Long-horizon Visual Generation and Navigation in 3D Space
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation
- 2026SearchWorld: Spatial Value-Grounded Imagination for UAV Object Search via World Models
- 2026DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigation