3D Gaussian Splatting with Fisheye Images: Field of View Analysis and Depth-Based Initialization
Not on the map. Why?
Abstract (arXiv)
We present the first evaluation of 3D Gaussian Splatting methods on real fisheye imagery with fields of view above 180textdegree. Our study evaluates Fisheye-GS citeliao2024fisheyegslightweightextensiblegaussian and 3DGUT citewu20253dgut on indoor and outdoor scenes captured with 200textdegree fisheye cameras, with the aim of assessing the practicality of wide-angle reconstruction under severe distortion. By comparing reconstructions at 200textdegree, 160textdegree, and 120textdegree field-of-view, we show that both methods achieve their best results at 160textdegree, which balances scene coverage with image quality, while distortion at 200textdegree degrades performance. To address the common failure of Structure-from-Motion (SfM) initialization at such wide angles, we introduce a depth-based alternative using UniK3D (Universal Camera Monocular 3D Estimation) citepiccinelli2025unik3d. This represents the first application of UniK3D to fisheye imagery beyond 200textdegree, despite the model not being trained on such data. With the number of predicted points controlled to match SfM for fairness, UniK3D produces geometrically accurate reconstructions that rival or surpass SfM, even in challenging scenes with fog, glare, or open sky. These results demonstrate the feasibility of fisheye-based 3D Gaussian Splatting and provides a benchmark for future research on wide-angle reconstruction from sparse and distorted inputs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 41 references that are in the map. First posted on arXiv 9 Aug 2025.
Builds on
17 of 41 references.
References · 17
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 210
- 20243DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splattingcited by 87
- 2023SMERF: Streamable Memory Efficient Radiance Fields for Real-Time Large-Scene Explorationcited by 62
- 2025UniK3D: Universal Camera Monocular 3D Estimationcited by 60
- 2018The promises and pitfalls of Stochastic Gradient Langevin Dynamicscited by 56
- 2024On the Error Analysis of 3D Gaussian Splatting and an Optimal Projection Strategycited by 39
- 2019FisheyeDistanceNet: Self-Supervised Scale-Aware Distance Estimation using Monocular Fisheye Camera for Autonomous Drivingcited by 36
5 more
- 2020UnRectDepthNet: Self-Supervised Monocular Depth Estimation using a Generic Framework for Handling Common Camera Distortion Modelscited by 33
- 2024Fisheye-GS: Lightweight and Extensible Gaussian Splatting Module for Fisheye Camerascited by 22
- 2025Self-Calibrating Gaussian Splatting for Large Field of View Reconstructioncited by 10
- 2024FisheyeDepth: A Real Scale Self-Supervised Depth Estimation Model for Fisheye Cameracited by 8
- 2025FIORD: A Fisheye Indoor-Outdoor Dataset with LIDAR Ground Truth for 3D Scene Reconstruction and Benchmarkingcited by 7
Built on by
Not cited yet.