mlsanityData to 7 Oct 2026

Fisheye-GS: Lightweight and Extensible Gaussian Splatting Module for Fisheye Cameras

arXiv 2409.04751 ↗First posted 7 Sep 2024cs.CV cs.GRcited by 22

Not on the map. Why?

Abstract (arXiv)

Recently, 3D Gaussian Splatting (3DGS) has garnered attention for its high fidelity and real-time rendering. However, adapting 3DGS to different camera models, particularly fisheye lenses, poses challenges due to the unique 3D to 2D projection calculation. Additionally, there are inefficiencies in the tile-based splatting, especially for the extreme curvature and wide field of view of fisheye lenses, which are crucial for its broader real-life applications. To tackle these challenges, we introduce Fisheye-GS.This innovative method recalculates the projection transformation and its gradients for fisheye cameras. Our approach can be seamlessly integrated as a module into other efficient 3D rendering methods, emphasizing its extensibility, lightweight nature, and modular design. Since we only modified the projection component, it can also be easily adapted for use with different camera models. Compared to methods that train after undistortion, our approach demonstrates a clear improvement in visual quality.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 28 of its 41 references that are in the map. First posted on arXiv 7 Sep 2024.

Builds on

28 of 41 references.

References · 28

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  4. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  5. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  6. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  7. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  8. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  9. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  10. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
  11. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  12. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
16 more
  1. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  2. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
  3. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  4. 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
  5. 2021Self-Calibrating Neural Radiance Fieldscited by 204
  6. 2023Multi-Scale 3D Gaussian Splatting for Anti-Aliased Renderingcited by 137
  7. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
  8. 2024FlashGS: Efficient 3D Gaussian Splatting for Large-scale and High-resolution Renderingcited by 85
  9. 2024Analytic-Splatting: Anti-Aliased 3D Gaussian Splatting via Analytic Integrationcited by 66
  10. 2023PERF: Panoramic Neural Radiance Field from a Single Panoramacited by 45
  11. 2024On the Error Analysis of 3D Gaussian Splatting and an Optimal Projection Strategycited by 39
  12. 2024360-GS: Layout-guided Panoramic Gaussian Splatting For Indoor Roamingcited by 35
  13. 2022360FusionNeRF: Panoramic Neural Radiance Fields with Joint Guidancecited by 23
  14. 2023Neural Lens Modelingcited by 7
  15. 2024Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challengescited by 3
  16. 2022OmniNeRF: Hybriding Omnidirectional Distance and Radiance fields for Neural Surface Reconstructioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 5; 2025: 8; 2026: 9.

22 papers.

Sort:

By area:

  1. 20243DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splattingcited by 87
  2. 2025LODGE: Level-of-Detail Large-Scale Gaussian Splatting with Efficient Renderingcited by 25
  3. 2024Gaussian Splatting for Efficient Satellite Image Photogrammetrycited by 15
  4. 2024UniGaussian: Driving Scene Reconstruction from Multiple Camera Models via Unified Gaussian Representationscited by 10
  5. 2025Self-Calibrating Gaussian Splatting for Large Field of View Reconstructioncited by 10
  6. 2024NeISF++: Neural Incident Stokes Field for Polarized Inverse Rendering of Conductors and Dielectricscited by 9
  7. 20253DGEER: 3D Gaussian Rendering Made Exact and Efficient for Generic Camerascited by 8
  8. 2026ParkGaussian: Surround-view 3D Gaussian Splatting for Autonomous Parkingcited by 7
  9. 2024GFreeDet: Exploiting Gaussian Splatting and Foundation Models for Model-free Unseen Object Detection in the BOP Challenge 2024cited by 3
  10. 2025SaLF: Sparse Local Fields for Multi-Sensor Rendering in Real-Timecited by 3
  11. 2025Wanderland: Geometrically Grounded Simulation for Open-World Embodied AIcited by 3
  12. 2026UniSHARP: Universal Sharp Monocular View Synthesiscited by 2
10 more
  1. 2025FisheyeGaussianLift: BEV Feature Lifting for Surround-View Fisheye Camera Perceptioncited by 1
  2. 2026DirectFisheye-GS: Enabling Native Fisheye Input in Gaussian Splatting with Cross-View Joint Optimizationcited by 1
  3. 20253D Gaussian Splatting with Fisheye Images: Field of View Analysis and Depth-Based Initializationcited by 0
  4. 2025Every Camera Effect, Every Time, All at Once: 4D Gaussian Ray Tracing for Physics-based Camera Effect Data Generationcited by 0
  5. 2026Drive-Through 3D Vehicle Exterior Reconstruction via Dynamic-Scene SfM and Distortion-Aware Gaussian Splattingcited by 0
  6. 2026Bringing a Personal Point of View: Evaluating Dynamic 3D Gaussian Splatting for Egocentric Scene Reconstructioncited by 0
  7. 2026UniTriSplat: A Unified 3D Gaussian Splatting Framework with Uniform Spherical Rasterization for Universal Camerascited by 0
  8. 2026Differentiable Voronoi Ray Tracing Beyond Rasterization Speedscited by 0
  9. 2026ConeGaussian: Anti-Aliased Gaussian Ray-Tracing for Generic Central Camerascited by 0
  10. 2026Light Field Primitive for Novel View Synthesiscited by 0