mlsanityData to 7 Oct 2026

Ref-GS: Directional Factorization for 2D Gaussian Splatting

arXiv 2412.00905 ↗First posted 1 Dec 2024cs.CV cs.GRcited by 27

Not on the map. Why?

Abstract (arXiv)

In this paper, we introduce Ref-GS, a novel approach for directional light factorization in 2D Gaussian splatting, which enables photorealistic view-dependent appearance rendering and precise geometry recovery. Ref-GS builds upon the deferred rendering of Gaussian splatting and applies directional encoding to the deferred-rendered surface, effectively reducing the ambiguity between orientation and viewing angle. Next, we introduce a spherical Mip-grid to capture varying levels of surface roughness, enabling roughness-aware Gaussian shading. Additionally, we propose a simple yet efficient geometry-lighting factorization that connects geometry and lighting via the vector outer product, significantly reducing renderer overhead when integrating volumetric attributes. Our method achieves superior photorealistic rendering for a range of open-world scenes while also accurately recovering geometry.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 39 of its 54 references that are in the map. First posted on arXiv 1 Dec 2024.

Builds on

39 of 54 references.

References · 39

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  6. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  7. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  8. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  9. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  10. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  11. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  12. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
27 more
  1. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  2. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  3. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  4. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  5. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  6. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  7. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  8. 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
  9. 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 238
  10. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
  11. 2023TensoIR: Tensorial Inverse Renderingcited by 166
  12. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  13. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 138
  14. 2022NeILF: Neural Incident Light Field for Physically-based Material Estimationcited by 105
  15. 2023Neural Point Catacaustics for Novel-View Synthesis of Reflectionscited by 81
  16. 2023NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimationcited by 73
  17. 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 73
  18. 2023ENVIDR: Implicit Differentiable Renderer with Neural Environment Lightingcited by 63
  19. 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 40
  20. 2023NeMF: Inverse Volume Rendering with Neural Microflake Fieldcited by 34
  21. 2022Eikonal Fields for Refractive Novel-View Synthesiscited by 30
  22. 2023SpecNeRF: Gaussian Directional Encoding for Specular Reflectionscited by 30
  23. 2024TensoSDF: Roughness-aware Tensorial Representation for Robust Geometry and Material Reconstructioncited by 26
  24. 2018Deep Surface Light Fieldscited by 23
  25. 20243iGS: Factorised Tensorial Illumination for 3D Gaussian Splattingcited by 16
  26. 2024Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modelingcited by 15
  27. 2024SpecGaussian with Latent Features: A High-quality Modeling of the View-dependent Appearance for 3D Gaussian Splattingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 14; 2026: 12.

27 papers.

Sort:

By area:

  1. 2024EnvGS: Modeling View-Dependent Appearance with Environment Gaussiancited by 34
  2. 2025MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inferencecited by 22
  3. 2025Neural Shell Texture Splatting: More Details and Fewer Primitivescited by 14
  4. 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGScited by 10
  5. 2025Spherical Voronoi: Directional Appearance as a Differentiable Partition of the Spherecited by 10
  6. 2025RGS-DR: Deferred Reflections and Residual Shading in 2D Gaussian Splattingcited by 3
  7. 2025SAGOnline: Segment Any Gaussians Onlinecited by 2
  8. 2025GOGS: High-Fidelity Geometry and Relighting for Glossy Objects via Gaussian Surfelscited by 2
  9. 2025MetroGS: Efficient and Stable Reconstruction of Geometrically Accurate High-Fidelity Large-Scale Scenescited by 2
  10. 2026RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splattingcited by 2
  11. 2026RT-GS: Gaussian Splatting with Reflection and Transmittance Primitivescited by 1
  12. 2026TransmissiveGS: Residual-Guided Disentangled Gaussian Splatting for Transmissive Scene Reconstruction and Renderingcited by 1
15 more
  1. 2025GS-2M: Material-aware Gaussian Splatting for High-fidelity Mesh Reconstructioncited by 0
  2. 2025Spec-Gloss Surfels and Normal-Diffuse Priors for Relightable Glossy Objectscited by 0
  3. 2025Pygmalion Effect in Vision: Image-to-Clay Translation for Reflective Geometry Reconstructioncited by 0
  4. 2025PolarGuide-GSDR: 3D Gaussian Splatting Driven by Polarization Priors and Deferred Reflection for Real-World Reflective Scenescited by 0
  5. 2025FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptationcited by 0
  6. 2025Beyond a Single Light: A Large-Scale Aerial Dataset for Urban Scene Reconstruction Under Varying Illuminationcited by 0
  7. 2026Augmented Radiance Field: A General Framework for Enhanced Gaussian Splattingcited by 0
  8. 2026SSR-GS: Separating Specular Reflection in Gaussian Splatting for Glossy Surface Reconstructioncited by 0
  9. 2026GLINT: Modeling Scene-Scale Transparency via Gaussian Radiance Transportcited by 0
  10. 2026Detailed Geometry and Appearance from Opportunistic Motioncited by 0
  11. 2026RefGlass-GS: A UAV-Enabled Fusion Framework for Photorealistic, Semantic and Interactive Digitization of Reflective Glass Facades via Gaussian Splattingcited by 0
  12. 2026Learning Spectral and Polarimetric Clues for One-to-Multimodal Novel View Synthesiscited by 0
  13. 2026PanoLess: Environment Reconstruction from Partial Reflective Viewscited by 0
  14. 2026STARS-GS: Structure-Aware Regularized Gaussian Splatting for Large-Scale Aerial Surface Reconstructioncited by 0
  15. 2026RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objectscited by 0