Skytopia: Monocular Drone Navigation with Action-Conditioned Latent World Models
On the map: World models → World models for navigation
Abstract (arXiv)
Monocular drone navigation requires reaching a goal in an unseen environment from a single forward-facing camera, which offers few cues for depth and scale. World models address this by modelling how observations evolve under actions, but they are built to be executed: the prediction is produced at deployment and fed back into action generation at every control step. We argue that what a policy needs from a world model is not the prediction but the representation required to produce it: in flight the executed action explains almost all of the change between observations, so prediction reduces to reprojecting a static scene under a known displacement. We therefore introduce skytopia, a policy built on an action-conditioned latent world model, and the 3D Gaussian Splatting platform on which it is trained. A forward objective predicts the representation of the next observation from the intended motion, and an inverse objective recovers that motion from the predicted transition. Because the prediction never reaches action generation, the predictor is discarded and one policy serves point-goal, image-goal, and goal-free navigation. Simulation experiments show that skytopia outperforms every baseline under all three specifications, attaining 57.8%, 66.0%, and 49.0% success rate, while discarding the predictor removes 59.4% of the inference cost. The same policy is subsequently deployed on a physical drone without fine-tuning and reaches goals in indoor, open outdoor, and woodland environments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 42 of its 45 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
42 of 45 references.
Closest ancestors · 12
Same direction, newest first
- 2026UniNav: A Unified World-Action Diffusion Model for Visual Navigation4 Aug
- 2026FutureNav: Unified World-Action Modeling for Vision-and-Language Navigation29 Jun
- 2026WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation3 Jun
- 2026AirDreamer: Generalist Drone Navigation with World Models2 Jun
- 2026WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigation15 May
- 2026World Model for Robot Learning: A Comprehensive Survey30 Apr
- 2026Policy-Guided World Model Planning for Language-Conditioned Visual Navigation26 Mar
- 2026Language-Conditioned World Modeling for Visual Navigation23 Mar
- 2026RAE-NWM: Navigation World Model in Dense Visual Representation Space10 Mar
- 2025AstraNav-World: World Model for Foresight Control and Consistency25 Dec
- 2025NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environments30 Jun
- 2024Navigation World Models4 Dec
Other references · 30
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 234
- 2023ViNT: A Foundation Model for Visual Navigationcited by 210
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 199
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 161
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
18 more
- 2021Rapid Exploration for Open-World Navigation with Latent Goal Modelscited by 118
- 2021Learning High-Speed Flight in the Wildcited by 98
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 92
- 2024Mobility VLA: Multimodal Instruction Navigation with Long-Context VLMs and Topological Graphscited by 72
- 2025Embodied Navigation Foundation Modelcited by 65
- 2022ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hintscited by 55
- 2025NavDP: Learning Sim-to-Real Navigation Diffusion Policy with Privileged Information Guidancecited by 46
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 43
- 2025OmniVLA: An Omni-Modal Vision-Language-Action Model for Robot Navigationcited by 34
- 2026Hierarchical Planning with Latent World Modelscited by 34
- 2024Grounding Video Models to Actions through Goal Conditioned Explorationcited by 25
- 2024Back to Newton's Laws: Learning Vision-based Agile Flight via Differentiable Physicscited by 24
- 2025Prior Does Matter: Visual Navigation via Denoising Diffusion Bridge Modelscited by 24
- 2025NaviDiffusor: Cost-Guided Diffusion Model for Visual Navigationcited by 23
- 2025Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understandingcited by 17
- 2026Sparse Video Generation Propels Real-World Beyond-the-View Vision-Language Navigationcited by 10
- 2026NavDreamer: Video Models as Zero-Shot 3D Navigatorscited by 9
- 2026ImagiNav: Scalable Embodied Navigation via Generative Visual Prediction and Inverse Dynamicscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DroneWAM: Efficient World Action Model for Drone Visual Navigation
- 2026WorldFly: A World-Model-Based Vision-Language-Action Model for UAV Navigation
- 2026DeTrack: A Benchmark and Altitude-Aware Dual World Model for Drone-embodied Tracking
- 2025Aerial World Model for Long-horizon Visual Generation and Navigation in 3D Space
- 2026AeroAct: Action-Centered World-Action Models for Language-Conditioned Quadrotor Flight
- 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigation
- 2026AirAnchor: Bridging Local and Global Spatial Information for Zero-Shot Aerial Vision-and-Language Navigation
- 2026SearchWorld: Spatial Value-Grounded Imagination for UAV Object Search via World Models