NavGen: Visual Generative Models as a Scalable Data Engine for Embodied 3D Navigation
Not on the map. Why?
Abstract (arXiv)
General-purpose robot models increasingly rely on large and diverse datasets. For embodied 3D navigation, however, existing data sources face a fundamental trade-off: simulated data can be generated at scale but often suffer from the visual sim-to-real gap, whereas real-world flight data provide realistic observations but are costly to collect. This paper studies another direction: the use of high-fidelity visual generative models as scalable data engines for embodied 3D navigation. We introduce NavGen, a text-to-video data generation pipeline that produces diverse vision-language navigation (VLN) episodes across indoor and outdoor scenes. We also propose a style-diversification method that scales up long-tail data that are difficult and costly to collect. The resulting dataset contains approximately 400K navigation episodes. We evaluate our dataset against existing UAV navigation datasets across multiple metrics, and find that the model trained on our data generally improves with scale, outperforming those trained on existing datasets. To validate real-world transferability, we deploy the trained model in world-action-model paradigm to real-world flying experiments. The final model achieves a 75% success rate across different navigation tasks and environments.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 36 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
32 of 36 references.
References · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2025Qwen-Image Technical Reportcited by 1,044
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
- 2026Causal World Modeling for Robot Controlcited by 321
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
20 more
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Modelscited by 283
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2023Scalable 3D Captioning with Pretrained Modelscited by 203
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Modelscited by 179
- 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 177
- 2024Towards Realistic UAV Vision-Language Navigation: Platform, Benchmark, and Methodologycited by 95
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2020EGO-Planner: An ESDF-free Gradient-based Local Planner for Quadrotorscited by 55
- 2025Openfly: A comprehensive platform for aerial vision-language navigationcited by 46
- 2025UAV-Flow Colosseo: A Real-World Benchmark for Flying-on-a-Word UAV Imitation Learningcited by 31
- 2025VLA-AN: An Efficient and Onboard Vision-Language-Action Framework for Aerial Navigation in Complex Environmentscited by 23
- 2025X-Humanoid: Robotize Human Videos to Generate Humanoid Videos at Scalecited by 12
- 2025IndoorUAV: Benchmarking Vision-Language UAV Navigation in Continuous Indoor Environmentscited by 10
- 2026NavDreamer: Video Models as Zero-Shot 3D Navigatorscited by 9
- 2026RoboCurate: Harnessing Diversity with Action-Verified Neural Trajectory for Robot Learningcited by 8
- 2025RoboTransfer: Controllable Geometry-Consistent Video Diffusion for Manipulation Policy Transfercited by 7
- 2026Lucid-XR: An Extended-Reality Data Engine for Robotic Manipulationcited by 4
- 2026FlyMirage: A Fully Automated Generation Pipeline for Diverse and Scalable UAV Flight Data via Generative World Modelcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026DiffWAM: A Fast and Efficient Navigation World Action Model30 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025FiLM-Nav: Efficient and Generalizable Navigation via VLM Fine-tuning
- 2025NavRAG: Generating User Demand Instructions for Embodied Navigation through Retrieval-Augmented LLM
- 2023Scaling Data Generation in Vision-and-Language Navigation
- 2026ImagiNav: Scalable Embodied Navigation via Generative Visual Prediction and Inverse Dynamics
- 2025Aerial World Model for Long-horizon Visual Generation and Navigation in 3D Space
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigation
- 2026AirNav: A Large-Scale UAV Vision-and-Language Navigation Dataset with Natural and Diverse Instructions
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Tasks