mlsanityData to 14 Oct 2026

AutoWeather4D: Autonomous Driving Video Weather Conversion via G-Buffer Dual-Pass Editing

arXiv 2603.26546 ↗First posted 27 Mar 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Generative video models have significantly advanced the photorealistic synthesis of adverse weather for autonomous driving; however, they consistently demand massive datasets to learn rare weather scenarios. While 3D-aware editing methods alleviate these data constraints by augmenting existing video footage, they are fundamentally bottlenecked by costly per-scene optimization and suffer from inherent geometric and illumination entanglement. In this work, we introduce AutoWeather4D, a feed-forward 3D-aware weather editing framework designed to explicitly decouple geometry and illumination. At the core of our approach is a G-buffer Dual-pass Editing mechanism. The Geometry Pass leverages explicit structural foundations to enable surface-anchored physical interactions, while the Light Pass analytically resolves light transport, accumulating the contributions of local illuminants into the global illumination to enable dynamic 3D local relighting. Extensive experiments demonstrate that AutoWeather4D achieves comparable photorealism and structural consistency to generative baselines while enabling fine-grained parametric physical control, serving as a practical data engine for autonomous driving.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 82 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

16 of 82 references.

References · 16

  1. 2025Qwen3-VL Technical Reportcited by 2,793
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  3. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  4. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  5. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  6. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 185
  7. 2023ADriver-I: A General World Model for Autonomous Drivingcited by 104
  8. 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
  9. 2024OccSora: 4D Occupancy Generation Models as World Simulators for Autonomous Drivingcited by 78
  10. 2024Unleashing Generalization of End-to-End Autonomous Driving with Controllable Long Video Generationcited by 55
  11. 2025R3D2: Realistic 3D Asset Insertion via Diffusion for Autonomous Driving Simulationcited by 18
  12. 2025WeatherEdit: Controllable Weather Editing with 4D Gaussian Fieldcited by 12
4 more
  1. 2024Retinex-Diffusion: On Controlling Illumination Conditions in Diffusion Models via Retinex Theorycited by 8
  2. 2025CausNVS: Autoregressive Multi-view Diffusion for Flexible 3D Novel View Synthesiscited by 6
  3. 2025Weather-Magician: Reconstruction and Rendering Framework for 4D Weather Synthesis In Real Timecited by 4
  4. 2025IntrinsicWeather: Controllable Weather Editing in Intrinsic Spacecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.