Ref-GS: Directional Factorization for 2D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce Ref-GS, a novel approach for directional light factorization in 2D Gaussian splatting, which enables photorealistic view-dependent appearance rendering and precise geometry recovery. Ref-GS builds upon the deferred rendering of Gaussian splatting and applies directional encoding to the deferred-rendered surface, effectively reducing the ambiguity between orientation and viewing angle. Next, we introduce a spherical Mip-grid to capture varying levels of surface roughness, enabling roughness-aware Gaussian shading. Additionally, we propose a simple yet efficient geometry-lighting factorization that connects geometry and lighting via the vector outer product, significantly reducing renderer overhead when integrating volumetric attributes. Our method achieves superior photorealistic rendering for a range of open-world scenes while also accurately recovering geometry.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 39 of its 54 references that are in the map. First posted on arXiv 1 Dec 2024.
Builds on
39 of 54 references.
References · 39
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
27 more
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
- 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 238
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
- 2023TensoIR: Tensorial Inverse Renderingcited by 166
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 138
- 2022NeILF: Neural Incident Light Field for Physically-based Material Estimationcited by 105
- 2023Neural Point Catacaustics for Novel-View Synthesis of Reflectionscited by 81
- 2023NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimationcited by 73
- 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 73
- 2023ENVIDR: Implicit Differentiable Renderer with Neural Environment Lightingcited by 63
- 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 40
- 2023NeMF: Inverse Volume Rendering with Neural Microflake Fieldcited by 34
- 2022Eikonal Fields for Refractive Novel-View Synthesiscited by 30
- 2023SpecNeRF: Gaussian Directional Encoding for Specular Reflectionscited by 30
- 2024TensoSDF: Roughness-aware Tensorial Representation for Robust Geometry and Material Reconstructioncited by 26
- 2018Deep Surface Light Fieldscited by 23
- 20243iGS: Factorised Tensorial Illumination for 3D Gaussian Splattingcited by 16
- 2024Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modelingcited by 15
- 2024SpecGaussian with Latent Features: A High-quality Modeling of the View-dependent Appearance for 3D Gaussian Splattingcited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 14; 2026: 12.
27 papers.
Sort:
By area:
- 2024EnvGS: Modeling View-Dependent Appearance with Environment Gaussiancited by 34
- 2025MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inferencecited by 22
- 2025Neural Shell Texture Splatting: More Details and Fewer Primitivescited by 14
- 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGScited by 10
- 2025Spherical Voronoi: Directional Appearance as a Differentiable Partition of the Spherecited by 10
- 2025RGS-DR: Deferred Reflections and Residual Shading in 2D Gaussian Splattingcited by 3
- 2025SAGOnline: Segment Any Gaussians Onlinecited by 2
- 2025GOGS: High-Fidelity Geometry and Relighting for Glossy Objects via Gaussian Surfelscited by 2
- 2025MetroGS: Efficient and Stable Reconstruction of Geometrically Accurate High-Fidelity Large-Scale Scenescited by 2
- 2026RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splattingcited by 2
- 2026RT-GS: Gaussian Splatting with Reflection and Transmittance Primitivescited by 1
- 2026TransmissiveGS: Residual-Guided Disentangled Gaussian Splatting for Transmissive Scene Reconstruction and Renderingcited by 1
15 more
- 2025GS-2M: Material-aware Gaussian Splatting for High-fidelity Mesh Reconstructioncited by 0
- 2025Spec-Gloss Surfels and Normal-Diffuse Priors for Relightable Glossy Objectscited by 0
- 2025Pygmalion Effect in Vision: Image-to-Clay Translation for Reflective Geometry Reconstructioncited by 0
- 2025PolarGuide-GSDR: 3D Gaussian Splatting Driven by Polarization Priors and Deferred Reflection for Real-World Reflective Scenescited by 0
- 2025FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptationcited by 0
- 2025Beyond a Single Light: A Large-Scale Aerial Dataset for Urban Scene Reconstruction Under Varying Illuminationcited by 0
- 2026Augmented Radiance Field: A General Framework for Enhanced Gaussian Splattingcited by 0
- 2026SSR-GS: Separating Specular Reflection in Gaussian Splatting for Glossy Surface Reconstructioncited by 0
- 2026GLINT: Modeling Scene-Scale Transparency via Gaussian Radiance Transportcited by 0
- 2026Detailed Geometry and Appearance from Opportunistic Motioncited by 0
- 2026RefGlass-GS: A UAV-Enabled Fusion Framework for Photorealistic, Semantic and Interactive Digitization of Reflective Glass Facades via Gaussian Splattingcited by 0
- 2026Learning Spectral and Polarimetric Clues for One-to-Multimodal Novel View Synthesiscited by 0
- 2026PanoLess: Environment Reconstruction from Partial Reflective Viewscited by 0
- 2026STARS-GS: Structure-Aware Regularized Gaussian Splatting for Large-Scale Aerial Surface Reconstructioncited by 0
- 2026RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objectscited by 0
- 2026RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objects16 Sep 2026
- 2026STARS-GS: Structure-Aware Regularized Gaussian Splatting for Large-Scale Aerial Surface Reconstruction3 Sep 2026
- 2026PanoLess: Environment Reconstruction from Partial Reflective Views28 Jul 2026
- 2026Learning Spectral and Polarimetric Clues for One-to-Multimodal Novel View Synthesis2 Jul 2026
- 2026RefGlass-GS: A UAV-Enabled Fusion Framework for Photorealistic, Semantic and Interactive Digitization of Reflective Glass Facades via Gaussian Splatting27 Jun 2026
- 2026RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting18 May 2026
- 2026TransmissiveGS: Residual-Guided Disentangled Gaussian Splatting for Transmissive Scene Reconstruction and Rendering11 May 2026
- 2026RT-GS: Gaussian Splatting with Reflection and Transmittance Primitives1 Apr 2026
- 2026Detailed Geometry and Appearance from Opportunistic Motion27 Mar 2026
- 2026GLINT: Modeling Scene-Scale Transparency via Gaussian Radiance Transport27 Mar 2026
- 2026SSR-GS: Separating Specular Reflection in Gaussian Splatting for Glossy Surface Reconstruction5 Mar 2026
- 2026Augmented Radiance Field: A General Framework for Enhanced Gaussian Splatting23 Feb 2026
15 more
- 2025Beyond a Single Light: A Large-Scale Aerial Dataset for Urban Scene Reconstruction Under Varying Illumination16 Dec 2025
- 2025Spherical Voronoi: Directional Appearance as a Differentiable Partition of the Sphere16 Dec 2025
- 2025FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptation10 Dec 2025
- 2025PolarGuide-GSDR: 3D Gaussian Splatting Driven by Polarization Priors and Deferred Reflection for Real-World Reflective Scenes2 Dec 2025
- 2025Pygmalion Effect in Vision: Image-to-Clay Translation for Reflective Geometry Reconstruction26 Nov 2025
- 2025MetroGS: Efficient and Stable Reconstruction of Geometrically Accurate High-Fidelity Large-Scale Scenes24 Nov 2025
- 2025MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inference13 Oct 2025
- 2025Spec-Gloss Surfels and Normal-Diffuse Priors for Relightable Glossy Objects2 Oct 2025
- 2025GS-2M: Material-aware Gaussian Splatting for High-fidelity Mesh Reconstruction26 Sep 2025
- 2025GOGS: High-Fidelity Geometry and Relighting for Glossy Objects via Gaussian Surfels20 Aug 2025
- 2025SAGOnline: Segment Any Gaussians Online11 Aug 2025
- 2025Neural Shell Texture Splatting: More Details and Fewer Primitives27 Jul 2025
- 2025RGS-DR: Deferred Reflections and Residual Shading in 2D Gaussian Splatting25 Apr 2025
- 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGS5 Apr 2025
- 2024EnvGS: Modeling View-Dependent Appearance with Environment Gaussian19 Dec 2024
- 2024EnvGS: Modeling View-Dependent Appearance with Environment Gaussiancited by 34
- 2025MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inferencecited by 22
- 2025Neural Shell Texture Splatting: More Details and Fewer Primitivescited by 14
- 20253R-GS: Best Practice in Optimizing Camera Poses Along with 3DGScited by 10
- 2025Spherical Voronoi: Directional Appearance as a Differentiable Partition of the Spherecited by 10
- 2025RGS-DR: Deferred Reflections and Residual Shading in 2D Gaussian Splattingcited by 3
- 2025SAGOnline: Segment Any Gaussians Onlinecited by 2
- 2025GOGS: High-Fidelity Geometry and Relighting for Glossy Objects via Gaussian Surfelscited by 2
- 2025MetroGS: Efficient and Stable Reconstruction of Geometrically Accurate High-Fidelity Large-Scale Scenescited by 2
- 2026RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splattingcited by 2
- 2026RT-GS: Gaussian Splatting with Reflection and Transmittance Primitivescited by 1
- 2026TransmissiveGS: Residual-Guided Disentangled Gaussian Splatting for Transmissive Scene Reconstruction and Renderingcited by 1
12 most cited of 26 All 26 (JSON)
- 2026RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objects16 Sep 2026
- 2026STARS-GS: Structure-Aware Regularized Gaussian Splatting for Large-Scale Aerial Surface Reconstruction3 Sep 2026
- 2026PanoLess: Environment Reconstruction from Partial Reflective Views28 Jul 2026
- 2026Learning Spectral and Polarimetric Clues for One-to-Multimodal Novel View Synthesis2 Jul 2026
- 2026RefGlass-GS: A UAV-Enabled Fusion Framework for Photorealistic, Semantic and Interactive Digitization of Reflective Glass Facades via Gaussian Splatting27 Jun 2026
- 2026RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting18 May 2026
- 2026TransmissiveGS: Residual-Guided Disentangled Gaussian Splatting for Transmissive Scene Reconstruction and Rendering11 May 2026
- 2026RT-GS: Gaussian Splatting with Reflection and Transmittance Primitives1 Apr 2026
- 2026Detailed Geometry and Appearance from Opportunistic Motion27 Mar 2026
- 2026GLINT: Modeling Scene-Scale Transparency via Gaussian Radiance Transport27 Mar 2026
- 2026SSR-GS: Separating Specular Reflection in Gaussian Splatting for Glossy Surface Reconstruction5 Mar 2026
- 2026Augmented Radiance Field: A General Framework for Enhanced Gaussian Splatting23 Feb 2026
12 newest of 26 All 26 (JSON)