# SeaSplat: Representing Underwater Scenes with 3D Gaussian Splatting and a Physically Grounded Image Formation Model

arXiv: https://arxiv.org/abs/2409.17345 · HTML: https://mlsanity.com/paper/2409.17345/

## Key facts

- Cited by 36 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 40 references that are in the map.
- First posted on arXiv 25 Sep 2024.

## Builds on (most cited first, 22 of 22)

- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [3D Gaussian Splatting for Real-Time Radiance Field Rendering](https://mlsanity.com/paper/2308.04079/) (2023)
- [Instant Neural Graphics Primitives with a Multiresolution Hash Encoding](https://mlsanity.com/paper/2201.05989/) (2022)
- [Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields](https://mlsanity.com/paper/2111.12077/) (2021)
- [Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields](https://mlsanity.com/paper/2103.13415/) (2021)
- [Plenoxels: Radiance Fields without Neural Networks](https://mlsanity.com/paper/2112.05131/) (2021)
- [Nerfies: Deformable Neural Radiance Fields](https://mlsanity.com/paper/2011.12948/) (2020)
- [Unsupervised Monocular Depth Estimation with Left-Right Consistency](https://mlsanity.com/paper/1609.03677/) (2016)
- [Neural Fields in Visual Computing and Beyond](https://mlsanity.com/paper/2111.11426/) (2021)
- [Advances in Neural Rendering](https://mlsanity.com/paper/2111.05849/) (2021)
- [Fast Underwater Image Enhancement for Improved Visual Perception](https://mlsanity.com/paper/1903.09766/) (2019)
- [DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshing](https://mlsanity.com/paper/2403.17822/) (2024)
- [latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction](https://mlsanity.com/paper/2403.16292/) (2024)
- [WaterGAN: Unsupervised Generative Network to Enable Real-time Color Correction of Monocular Underwater Images](https://mlsanity.com/paper/1702.07392/) (2017)
- [Enhancing Underwater Imagery using Generative Adversarial Networks](https://mlsanity.com/paper/1801.04011/) (2018)
- [SeaThru-NeRF: Neural Radiance Fields in Scattering Media](https://mlsanity.com/paper/2304.07743/) (2023)
- [Beyond NeRF Underwater: Learning Neural Reflectance Fields for True Color Correction of Marine Imagery](https://mlsanity.com/paper/2304.03384/) (2023)
- [Semi-Supervised Visual Tracking of Marine Animals using Autonomous Underwater Vehicles](https://mlsanity.com/paper/2302.07344/) (2023)
- [RecGS: Removing Water Caustic with Recurrent Gaussian Splatting](https://mlsanity.com/paper/2407.10318/) (2024)
- [CUREE: A Curious Underwater Robot for Ecosystem Exploration](https://mlsanity.com/paper/2303.03943/) (2023)
- [Osmosis: RGBD Diffusion Prior for Underwater Image Restoration](https://mlsanity.com/paper/2403.14837/) (2024)
- [DeepSeeColor: Realtime Adaptive Color Correction for Autonomous Underwater Vehicles via Deep Learning Methods](https://mlsanity.com/paper/2303.04025/) (2023)

## Built on by (most cited first, 30 of 36)

- [Momentum-GS: Momentum Gaussian Self-Distillation for High-Quality Large Scene Reconstruction](https://mlsanity.com/paper/2412.04887/) (2024)
- [RealX3D: A Physically-Degraded 3D Benchmark for Multi-view Visual Restoration and Reconstruction](https://mlsanity.com/paper/2512.23437/) (2025)
- [GenSmoke-GS: A Multi-Stage Method for Novel View Synthesis from Smoke-Degraded Images Using a Generative Model](https://mlsanity.com/paper/2604.03039/) (2026)
- [Gaussian Splashing: Direct Volumetric Rendering Underwater](https://mlsanity.com/paper/2411.19588/) (2024)
- [3D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Models](https://mlsanity.com/paper/2604.05687/) (2026)
- [SmokeGS-R: Physics-Guided Pseudo-Clean 3DGS for Real-World Multi-View Smoke Restoration](https://mlsanity.com/paper/2604.05301/) (2026)
- [SonarSplat: Novel View Synthesis of Imaging Sonar via Gaussian Splatting](https://mlsanity.com/paper/2504.00159/) (2025)
- [3D-UIR: 3D Gaussian for Underwater 3D Scene Reconstruction via Physics Based Appearance-Medium Decoupling](https://mlsanity.com/paper/2505.21238/) (2025)
- [DehazeGS: Seeing Through Fog with 3D Gaussian Splatting](https://mlsanity.com/paper/2501.03659/) (2025)
- [RUSplatting: Robust 3D Gaussian Splatting for Sparse-View Underwater Scene Reconstruction](https://mlsanity.com/paper/2505.15737/) (2025)
- [Holistic Large-Scale Scene Reconstruction via Mixed Gaussian Splatting](https://mlsanity.com/paper/2505.23280/) (2025)
- [Compensating Spatiotemporally Inconsistent Observations for Online Dynamic 3D Gaussian Splatting](https://mlsanity.com/paper/2505.01235/) (2025)
- [AI-Driven Marine Robotics: Emerging Trends in Underwater Perception and Ecosystem Monitoring](https://mlsanity.com/paper/2509.01878/) (2025)
- [AquaFuse: Waterbody Fusion for Physics Guided View Synthesis of Underwater Scenes](https://mlsanity.com/paper/2411.01119/) (2024)
- [From Restoration to Reconstruction: Rethinking 3D Gaussian Splatting for Underwater Scenes](https://mlsanity.com/paper/2509.17789/) (2025)
- [OceanSplat: Object-aware Gaussian Splatting with Trinocular View Consistency for Underwater Scene Reconstruction](https://mlsanity.com/paper/2601.04984/) (2026)
- [NimbusGS: Unified 3D Scene Reconstruction under Hybrid Weather](https://mlsanity.com/paper/2603.27228/) (2026)
- [Spatiotemporal Degradation-Aware 3D Gaussian Splatting for Realistic Underwater Scene Reconstruction](https://mlsanity.com/paper/2604.23551/) (2026)
- [Semantic-guided Gaussian Splatting for High-Fidelity Underwater Scene Reconstruction](https://mlsanity.com/paper/2509.00800/) (2025)
- [WaterClear-GS: Optical-Aware Gaussian Splatting for Underwater Reconstruction and Restoration](https://mlsanity.com/paper/2601.19753/) (2026)
- [Wat3R: Underwater 3D Geometry Learning without Annotations](https://mlsanity.com/paper/2607.08772/) (2026)
- [WAT3R: Feedforward Underwater 3D Reconstruction](https://mlsanity.com/paper/2607.21023/) (2026)
- [Swimm3R: Splatting with Medium-aware SfM for Underwater 3D Reconstruction](https://mlsanity.com/paper/2608.00950/) (2026)
- [TUGS: Physics-based Compact Representation of Underwater Scenes by Tensorized Gaussian](https://mlsanity.com/paper/2505.08811/) (2025)
- [UEOF: A Benchmark Dataset for Underwater Event-Based Optical Flow](https://mlsanity.com/paper/2601.10054/) (2026)
- [BALTIC: A Benchmark and Cross-Domain Strategy for 3D Reconstruction Across Air and Underwater Domains Under Varying Illumination](https://mlsanity.com/paper/2604.19133/) (2026)
- [Underwater360: Reconstructing Underwater Scenes from Panoramic Images with Omnidirectional Gaussian Splatting](https://mlsanity.com/paper/2605.26447/) (2026)
- [Ocean4D: Generative Underwater 4D Reconstruction via Medium-Aware Video Diffusion](https://mlsanity.com/paper/2606.23298/) (2026)
- [NemoSplat: Feed-Forward 4D Gaussian Splatting for Media-Aware Underwater Reconstruction](https://mlsanity.com/paper/2608.22888/) (2026)
- [AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstruction](https://mlsanity.com/paper/2608.22906/) (2026)

## Abstract (arXiv)

We introduce SeaSplat, a method to enable real-time rendering of underwater scenes leveraging recent advances in 3D radiance fields. Underwater scenes are challenging visual environments, as rendering through a medium such as water introduces both range and color dependent effects on image capture. We constrain 3D Gaussian Splatting (3DGS), a recent advance in radiance fields enabling rapid training and real-time rendering of full 3D scenes, with a physically grounded underwater image formation model. Applying SeaSplat to the real-world scenes from SeaThru-NeRF dataset, a scene collected by an underwater vehicle in the US Virgin Islands, and simulation-degraded real-world scenes, not only do we see increased quantitative performance on rendering novel viewpoints from the scene with the medium present, but are also able to recover the underlying true color of the scene and restore renders to be without the presence of the intervening medium. We show that the underwater image formation helps learn scene structure, with better depth maps, as well as show that our improvements maintain the significant computational improvements afforded by leveraging a 3D Gaussian representation.
