Generalization of World Models under Environmental Variability for Vision-based Quadrotor Navigation
On the map: World models → World models for navigation
Abstract (arXiv)
World models, learned generative models that predict how an environment evolves, have become a promising tool for sample-efficient robot learning. Yet how robust they are to environmental variability remains poorly understood. To address this, we conduct a systematic study using vision-based quadrotor navigation as a testbed problem, training DreamerV3-based world models under varying levels of environmental randomness and evaluating them across all levels through cross-environment validation, spanning both Self-Supervised Learning (SSL) pretraining and Reinforcement Learning (RL) fine-tuning. We then deploy all world models and associated navigation policies on a real quadrotor in unseen environments, including an open-loop run where the model receives just 2.5s of real sensory input before all sensors are cut off, leaving the system to navigate entirely in imagination over a 12m traverse. Our results show that world model robustness during SSL pretraining is a strong predictor of sim-to-real transfer: every model that generalized well in cross-environment SSL validation deployed successfully in the real world, passing through gaps as narrow as 0.67m, whereas the model that dominated simulation policy evaluation failed on the real platform. We further identify (a) the discrete latent size and (b) the training-sequence length as the dominant factors governing world model quality.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 3 of its 22 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
3 of 22 references.
Closest ancestors · 1
Same direction, newest first
Other references · 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026MAD: Mapping-Aware World Models for Agile Quadrotor Flight
- 2026AirDreamer: Generalist Drone Navigation with World Models
- 2025Dreaming Falcon: Physics-Informed Model-Based Reinforcement Learning for Quadcopters
- 2024X-MOBILITY: End-To-End Generalizable Navigation via World Modeling
- 2026Guided Diffusion with Distilled Vision-Language Reliability for Aerial Navigation
- 2026World Model for Robot Learning: A Comprehensive Survey
- 2025Aerial World Model for Long-horizon Visual Generation and Navigation in 3D Space
- 2026WorldFly: A World-Model-Based Vision-Language-Action Model for UAV Navigation