mlsanityData to 7 Oct 2026

DerainSplat: Feed-Forward Clean 3D Gaussian Splatting from Sparse Rainy Views

arXiv 2608.02191 ↗First posted 3 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Although image deraining has advanced substantially, existing methods mainly focus on 2D image restoration. As spatial intelligence applications such as embodied AI and autonomous driving continue to emerge, reconstructing clean 3D scenes from sparse rainy views in a feed-forward manner becomes increasingly important. Existing feed-forward 3D Gaussian Splatting (3DGS) methods often assume clean inputs and collapse under rainy conditions. To this end, we present textbftextitDerainSplat, a feed-forward framework that reconstructs clean 3D scenes from only a few rainy views. To support this task, we build a large-scale multi-view derain dataset through a four-stage synthesis pipeline that sequentially models overcast illumination, depth-dependent haze, rain streaks, and lens raindrops, producing privileged weather factors. We introduce a weather net that predicts the weather factors from rainy context and yields two support maps. Scene support modulates cross-view cost-volume matching, while radiance support drives depth-aligned appearance fusion to fill corrupted pixels. The derived geometry evidence further attenuates Gaussian opacity to reduce spurious structures. A rainy cycle consistency re-renders clean views using the predicted factors and aligns them with rainy inputs. Extensive experiments show that textbftextitDerainSplat outperforms existing methods on various datasets, including RealEstate10K, ACID, Mip-NeRF360, and real-world rainy scenes, with strong cross-dataset generalization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 39 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

26 of 39 references.

References · 26

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  4. 2021Multi-Stage Progressive Image Restorationcited by 813
  5. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  6. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  7. 2022Visual Language Maps for Robot Navigationcited by 362
  8. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
  9. 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 271
  10. 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
  11. 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 239
  12. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
14 more
  1. 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
  2. 2016Clearing the Skies: A deep network architecture for single-image rain removalcited by 136
  3. 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
  4. 2024TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformerscited by 71
  5. 2024DrivingForward: Feed-forward 3D Gaussian Splatting for Driving Scene Reconstruction from Flexible Surround-view Inputcited by 53
  6. 2023From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removalcited by 39
  7. 2023ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Renderingcited by 28
  8. 2020Rethinking Image Deraining via Rain Streaks and Vaporscited by 24
  9. 2024WeatherGS: 3D Scene Reconstruction in Adverse Weather Conditions via Gaussian Splattingcited by 13
  10. 2025Channel Consistency Prior and Self-Reconstruction Strategy Based Unsupervised Image Derainingcited by 11
  11. 2022GTAV-NightRain: Photometric Realistic Large-scale Dataset for Night-time Rain Streak Removalcited by 9
  12. 2024RainyScape: Unsupervised Rainy Scene Reconstruction using Decoupled Neural Renderingcited by 8
  13. 2025Rethinking Rainy 3D Scene Reconstruction via Perspective Transforming and Brightness Tuningcited by 4
  14. 2016Waterdrop Stereocited by 3

Built on by

Not cited yet.