A Neural Rendering Framework for Free-Viewpoint Relighting
Not on the map. Why?
Abstract (arXiv)
We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs. Existing neural rendering (NR) does not explicitly model the physical rendering process and hence has limited capabilities on relighting. RNR instead models image formation in terms of environment lighting, object intrinsic attributes, and light transport function (LTF), each corresponding to a learnable component. In particular, the incorporation of a physically based rendering process not only enables relighting but also improves the quality of view synthesis. Comprehensive experiments on synthetic and real data show that RNR provides a practical and effective solution for conducting free-viewpoint relighting.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 2; 2023: 8; 2024: 2; 2025: 1; 2026: 1.
26 papers.
Sort:
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
- 2021HDR-NeRF: High Dynamic Range Neural Radiance Fieldscited by 113
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
- 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functionscited by 65
- 2021Free-viewpoint Indoor Neural Relighting from Multi-view Stereocited by 50
- 2022Neural Radiance Transfer Fields for Relightable Novel-view Synthesis with Global Illuminationcited by 41
- 2023NeMF: Inverse Volume Rendering with Neural Microflake Fieldcited by 34
- 2021GMLight: Lighting Estimation via Geometric Distribution Approximationcited by 28
- 2024Sort-free Gaussian Splatting via Weighted Sum Renderingcited by 27
- 2021Convolutional Neural Opacity Radiance Fieldscited by 16
14 more
- 2023NeuFace: Realistic 3D Neural Face Rendering from Multi-view Imagescited by 12
- 2021MirrorNeRF: One-shot Neural Portrait Radiance Field from Multi-mirror Catadioptric Imagingcited by 9
- 2023Semantic-aware Occlusion Filtering Neural Radiance Fields in the Wildcited by 9
- 2023Perceptual Assessment and Optimization of HDR Image Renderingcited by 6
- 2021Controllable Data Augmentation Through Deep Relightingcited by 4
- 2023Light Sampling Field and BRDF Representation for Physically-based Neural Renderingcited by 4
- 2023SFDM: Robust Decomposition of Geometry and Reflectance for Realistic Face Rendering from Sparse-view Imagescited by 4
- 2021Data Augmentation for Object Detection via Differentiable Neural Renderingcited by 3
- 2021Joint Learning of Portrait Intrinsic Decomposition and Relightingcited by 3
- 2022Designing An Illumination-Aware Network for Deep Image Relightingcited by 3
- 2021Appearance Editing with Free-viewpoint Neural Renderingcited by 1
- 2024MixLight: Borrowing the Best of both Spherical Harmonics and Gaussian Modelscited by 1
- 2025NeuGen: Amplifying the 'Neural' in Neural Radiance Fields for Domain Generalizationcited by 0
- 20263D Gaussian Splatting for Efficient Retrospective Dynamic Scene Novel View Synthesis with a Standardized Benchmarkcited by 0
- 20263D Gaussian Splatting for Efficient Retrospective Dynamic Scene Novel View Synthesis with a Standardized Benchmark12 May 2026
- 2025NeuGen: Amplifying the 'Neural' in Neural Radiance Fields for Domain Generalization11 May 2025
- 2024Sort-free Gaussian Splatting via Weighted Sum Rendering24 Oct 2024
- 2024MixLight: Borrowing the Best of both Spherical Harmonics and Gaussian Models19 Apr 2024
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis28 Dec 2023
- 2023SFDM: Robust Decomposition of Geometry and Reflectance for Realistic Face Rendering from Sparse-view Images11 Dec 2023
- 2023Perceptual Assessment and Optimization of HDR Image Rendering19 Oct 2023
- 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functions27 Sep 2023
- 2023Light Sampling Field and BRDF Representation for Physically-based Neural Rendering11 Apr 2023
- 2023NeMF: Inverse Volume Rendering with Neural Microflake Field3 Apr 2023
- 2023NeuFace: Realistic 3D Neural Face Rendering from Multi-view Images24 Mar 2023
- 2023Semantic-aware Occlusion Filtering Neural Radiance Fields in the Wild5 Mar 2023
14 more
- 2022Neural Radiance Transfer Fields for Relightable Novel-view Synthesis with Global Illumination27 Jul 2022
- 2022Designing An Illumination-Aware Network for Deep Image Relighting21 Jul 2022
- 2021HDR-NeRF: High Dynamic Range Neural Radiance Fields29 Nov 2021
- 2021Controllable Data Augmentation Through Deep Relighting26 Oct 2021
- 2021Appearance Editing with Free-viewpoint Neural Rendering14 Oct 2021
- 2021Free-viewpoint Indoor Neural Relighting from Multi-view Stereo24 Jun 2021
- 2021Joint Learning of Portrait Intrinsic Decomposition and Relighting22 Jun 2021
- 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination3 Jun 2021
- 2021MirrorNeRF: One-shot Neural Portrait Radiance Field from Multi-mirror Catadioptric Imaging6 Apr 2021
- 2021Convolutional Neural Opacity Radiance Fields5 Apr 2021
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo29 Mar 2021
- 2021Data Augmentation for Object Detection via Differentiable Neural Rendering4 Mar 2021
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Rendering1 Mar 2021
- 2021GMLight: Lighting Estimation via Geometric Distribution Approximation20 Feb 2021
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
- 2021HDR-NeRF: High Dynamic Range Neural Radiance Fieldscited by 113
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
- 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functionscited by 65
- 2021Free-viewpoint Indoor Neural Relighting from Multi-view Stereocited by 50
- 2022Neural Radiance Transfer Fields for Relightable Novel-view Synthesis with Global Illuminationcited by 41
- 2023NeMF: Inverse Volume Rendering with Neural Microflake Fieldcited by 34
- 2021GMLight: Lighting Estimation via Geometric Distribution Approximationcited by 28
- 2024Sort-free Gaussian Splatting via Weighted Sum Renderingcited by 27
- 2021Convolutional Neural Opacity Radiance Fieldscited by 16
12 most cited of 26 All 26 (JSON)
- 20263D Gaussian Splatting for Efficient Retrospective Dynamic Scene Novel View Synthesis with a Standardized Benchmark12 May 2026
- 2025NeuGen: Amplifying the 'Neural' in Neural Radiance Fields for Domain Generalization11 May 2025
- 2024Sort-free Gaussian Splatting via Weighted Sum Rendering24 Oct 2024
- 2024MixLight: Borrowing the Best of both Spherical Harmonics and Gaussian Models19 Apr 2024
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis28 Dec 2023
- 2023SFDM: Robust Decomposition of Geometry and Reflectance for Realistic Face Rendering from Sparse-view Images11 Dec 2023
- 2023Perceptual Assessment and Optimization of HDR Image Rendering19 Oct 2023
- 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functions27 Sep 2023
- 2023Light Sampling Field and BRDF Representation for Physically-based Neural Rendering11 Apr 2023
- 2023NeMF: Inverse Volume Rendering with Neural Microflake Field3 Apr 2023
- 2023NeuFace: Realistic 3D Neural Face Rendering from Multi-view Images24 Mar 2023
- 2023Semantic-aware Occlusion Filtering Neural Radiance Fields in the Wild5 Mar 2023
12 newest of 26 All 26 (JSON)