mlsanityData to 7 Oct 2026

Zero-Shot UAV Navigation in Forests via Relightable 3D Gaussian Splatting

arXiv 2602.07101 ↗First posted 6 Feb 2026cs.CV cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

UAV navigation in unstructured outdoor environments using passive monocular vision is hindered by the substantial visual domain gap between simulation and reality. While 3D Gaussian Splatting enables photorealistic scene reconstruction from real-world data, existing methods inherently couple static lighting with geometry, severely limiting policy generalization to dynamic real-world illumination. In this paper, we propose a novel end-to-end reinforcement learning framework designed for effective zero-shot transfer to unstructured outdoors. Within a high-fidelity simulation grounded in real-world data, our policy is trained to map raw monocular RGB observations directly to continuous control commands. To overcome photometric limitations, we introduce Relightable 3D Gaussian Splatting, which decomposes scene components to enable explicit, physically grounded editing of environmental lighting within the neural representation. By augmenting training with diverse synthesized lighting conditions ranging from strong directional sunlight to diffuse overcast skies, we compel the policy to learn robust, illumination-invariant visual features. Extensive real-world experiments demonstrate that a lightweight quadrotor achieves robust, collision-free navigation in complex forest environments at speeds up to 10 m/s, exhibiting significant resilience to drastic lighting variations without fine-tuning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 50 references that are in the map. First posted on arXiv 6 Feb 2026.

Builds on

33 of 50 references.

References · 33

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  4. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
  5. 2016Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networkscited by 307
  6. 2016CAD2RL: Real Single-Image Flight without a Single Real Imagecited by 227
  7. 2021Vision-Only Robot Navigation in a Neural Radiance Worldcited by 153
  8. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 138
  9. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 114
  10. 2018Style Augmentation: Data Augmentation via Style Randomizationcited by 79
  11. 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learningcited by 76
  12. 2023Reaching the Limit in Autonomous Racing: Optimal Control versus Reinforcement Learningcited by 72
21 more
  1. 2020Flightmare: A Flexible Quadrotor Simulatorcited by 69
  2. 2024Splat-Nav: Safe Real-Time Robot Navigation in Gaussian Splatting Mapscited by 54
  3. 2020EGO-Planner: An ESDF-free Gradient-based Local Planner for Quadrotorscited by 47
  4. 2024GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse Renderingcited by 39
  5. 2024Back to Newton's Laws: Learning Vision-based Agile Flight via Differentiable Physicscited by 24
  6. 2018Memory-based Deep Reinforcement Learning for Obstacle Avoidance in UAV with Limited Environment Knowledgecited by 21
  7. 2024NavRL: Learning Safe Flight in Dynamic Environmentscited by 16
  8. 2025GRaD-Nav++: Vision-Language Model Enabled Visual Drone Navigation with Gaussian Radiance Fields and Differentiable Dynamicscited by 14
  9. 2020FASTER: Fast and Safe Trajectory Planner for Navigation in Unknown Environmentscited by 13
  10. 2022Learning Perception-Aware Agile Flight in Cluttered Environmentscited by 13
  11. 2025AirSim360: A Panoramic Simulation Platform within Drone Viewcited by 12
  12. 2023Contrastive Learning for Enhancing Robust Scene Transfer in Vision-based Agile Flightcited by 11
  13. 2022Bubble Planner: Planning High-speed Smooth Quadrotor Trajectories using Receding Corridorscited by 8
  14. 2023Aerial Gym -- Isaac Gym Simulator for Aerial Robotscited by 8
  15. 2024Reinforcement Learning for Collision-free Flight Exploiting Deep Collision Encodingcited by 8
  16. 2024MAVRL: Learn to Fly in Cluttered Environments with Varying Speedcited by 8
  17. 2024Seeing Through Pixel Motion: Learning Obstacle Avoidance from Optical Flow with One Cameracited by 7
  18. 2024Learning Speed Adaptation for Flight in Cluttercited by 6
  19. 2023Survey of Simulators for Aerial Robots: An Overview and In-Depth Systematic Comparisonscited by 5
  20. 2025Flying on Point Clouds with Reinforcement Learningcited by 4
  21. 2025Flying in Clutter on Monocular RGB by Learning in 3D Radiance Fields with Domain Adaptationcited by 3

Built on by

Not cited yet.