Neural BRDF Representation and Importance Sampling
Not on the map. Why?
Abstract (arXiv)
Controlled capture of real-world material appearance yields tabulated sets of highly realistic reflectance data. In practice, however, its high memory footprint requires compressing into a representation that can be used efficiently in rendering while remaining faithful to the original. Previous works in appearance encoding often prioritised one of these requirements at the expense of the other, by either applying high-fidelity array compression strategies not suited for efficient queries during rendering, or by fitting a compact analytic model that lacks expressiveness. We present a compact neural network-based representation of BRDF data that combines high-accuracy reconstruction with efficient practical rendering via built-in interpolation of reflectance. We encode BRDFs as lightweight networks, and propose a training scheme with adaptive angular sampling, critical for the accurate reconstruction of specular highlights. Additionally, we propose a novel approach to make our representation amenable to importance sampling: rather than inverting the trained networks, we learn to encode them in a more compact embedding that can be mapped to parameters of an analytic BRDF for which importance sampling is known. We evaluate encoding results on isotropic and anisotropic BRDFs from multiple real-world datasets, and importance sampling performance for isotropic BRDFs mapped to two different analytic models.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 11 of its 53 references that are in the map. First posted on arXiv 11 Feb 2021.
Builds on
11 of 53 references.
References · 11
- 2016Density estimation using Real NVPcited by 2,029
- 2014NICE: Non-linear Independent Components Estimationcited by 1,052
- 2020AutoInt: Automatic Integration for Fast Neural Volume Renderingcited by 204
- 2018Neural Importance Samplingcited by 154
- 2018Single-Image SVBRDF Capture with a Rendering-Aware Deep Networkcited by 116
- 2020Invertible Neural BRDF for Object Inverse Renderingcited by 17
- 2018Learning to Importance Sample in Primary Sample Spacecited by 9
- 2018Deep Appearance Mapscited by 7
- 2018Gaussian Material Synthesiscited by 6
- 2017Deep Scattering: Rendering Atmospheric Clouds with Radiance-Predicting Neural Networkscited by 3
- 2018Image-based remapping of spatially-varying material appearancecited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 6; 2024: 5; 2025: 5; 2026: 7.
28 papers.
Sort:
- 2022Differentiable Point-Based Radiance Fields for Efficient View Synthesiscited by 86
- 2022HyperTime: Implicit Neural Representation for Time Seriescited by 24
- 2022NeurMiPs: Neural Mixture of Planar Experts for View Synthesiscited by 23
- 2024Objects With Lighting: A Real-World Dataset for Evaluating Reconstruction and Rendering for Object Relightingcited by 18
- 2022Learning to Learn and Sample BRDFscited by 9
- 2026Generative World Renderercited by 8
- 2023Neural Fields with Hard Constraints of Arbitrary Differential Ordercited by 5
- 2023NeuBTF: Neural fields for BTF encoding and transfercited by 5
- 2023Real-Time Neural BRDF with Spherically Distributed Primitivescited by 4
- 2023Real-Time Neural Materials using Block-Compressed Featurescited by 4
- 2023Generating Parametric BRDFs from Natural Language Descriptionscited by 3
- 2023MADS: Modulated Auto-Decoding SIREN for time series imputationcited by 3
16 more
- 2024FROST-BRDF: A Fast and Robust Optimal Sampling Technique for BRDF Acquisitioncited by 3
- 2024Neural Product Importance Sampling via Warp Compositioncited by 3
- 2025Neural BRDF Importance Sampling by Reparameterizationcited by 3
- 2025On Neural BRDFs: A Thorough Comparison of State-of-the-Art Approachescited by 2
- 2021Neural BRDFs: Representation and Operationscited by 1
- 2024Physically Based Neural Bidirectional Reflectance Distribution Functioncited by 1
- 2025FACT-GS: Frequency-Aligned Complexity-Aware Texture Reparameterization for 2D Gaussian Splattingcited by 1
- 2026Lunar-G2R: Geometry-to-Reflectance Learning for High-Fidelity Lunar BRDF Estimationcited by 1
- 20268DNA: 8D Neural Asset Light Transport by Distribution Learningcited by 1
- 2024Neural Appearance Modeling From Single Imagescited by 0
- 2025GratNet: A Photorealistic Neural Shader for Diffractive Surfacescited by 0
- 2025FreNBRDF: A Frequency-Rectified Neural Material Representationcited by 0
- 2026A Hybrid Neural-Microfacet BRDF Model for Real-Time Renderingcited by 0
- 2026RenderFormer-V2: Neural Rendering with Heterogeneous Scene Primitivescited by 0
- 2026PIC: Revisiting INR for Image Coding with Fast Encoding and Sub-Millisecond Decodingcited by 0
- 2026RoomLight: A 2.5D Illumination Prior for Indoor Environmentscited by 0
- 2026RoomLight: A 2.5D Illumination Prior for Indoor Environments23 Sep 2026
- 2026PIC: Revisiting INR for Image Coding with Fast Encoding and Sub-Millisecond Decoding8 Sep 2026
- 2026RenderFormer-V2: Neural Rendering with Heterogeneous Scene Primitives4 Sep 2026
- 2026A Hybrid Neural-Microfacet BRDF Model for Real-Time Rendering10 Aug 2026
- 20268DNA: 8D Neural Asset Light Transport by Distribution Learning28 Apr 2026
- 2026Generative World Renderer2 Apr 2026
- 2026Lunar-G2R: Geometry-to-Reflectance Learning for High-Fidelity Lunar BRDF Estimation15 Jan 2026
- 2025FACT-GS: Frequency-Aligned Complexity-Aware Texture Reparameterization for 2D Gaussian Splatting28 Nov 2025
- 2025FreNBRDF: A Frequency-Rectified Neural Material Representation1 Jul 2025
- 2025GratNet: A Photorealistic Neural Shader for Diffractive Surfaces18 Jun 2025
- 2025Neural BRDF Importance Sampling by Reparameterization13 May 2025
- 2025On Neural BRDFs: A Thorough Comparison of State-of-the-Art Approaches21 Feb 2025
16 more
- 2024Physically Based Neural Bidirectional Reflectance Distribution Function4 Nov 2024
- 2024Neural Product Importance Sampling via Warp Composition12 Sep 2024
- 2024Neural Appearance Modeling From Single Images8 Jun 2024
- 2024Objects With Lighting: A Real-World Dataset for Evaluating Reconstruction and Rendering for Object Relighting17 Jan 2024
- 2024FROST-BRDF: A Fast and Robust Optimal Sampling Technique for BRDF Acquisition14 Jan 2024
- 2023Real-Time Neural Materials using Block-Compressed Features26 Oct 2023
- 2023Real-Time Neural BRDF with Spherically Distributed Primitives12 Oct 2023
- 2023NeuBTF: Neural fields for BTF encoding and transfer3 Jul 2023
- 2023MADS: Modulated Auto-Decoding SIREN for time series imputation3 Jul 2023
- 2023Generating Parametric BRDFs from Natural Language Descriptions19 Jun 2023
- 2023Neural Fields with Hard Constraints of Arbitrary Differential Order15 Jun 2023
- 2022Learning to Learn and Sample BRDFs7 Oct 2022
- 2022HyperTime: Implicit Neural Representation for Time Series11 Aug 2022
- 2022Differentiable Point-Based Radiance Fields for Efficient View Synthesis28 May 2022
- 2022NeurMiPs: Neural Mixture of Planar Experts for View Synthesis28 Apr 2022
- 2021Neural BRDFs: Representation and Operations6 Nov 2021
- 2022Differentiable Point-Based Radiance Fields for Efficient View Synthesiscited by 86
- 2022HyperTime: Implicit Neural Representation for Time Seriescited by 24
- 2022NeurMiPs: Neural Mixture of Planar Experts for View Synthesiscited by 23
- 2024Objects With Lighting: A Real-World Dataset for Evaluating Reconstruction and Rendering for Object Relightingcited by 18
- 2022Learning to Learn and Sample BRDFscited by 9
- 2026Generative World Renderercited by 8
- 2023Neural Fields with Hard Constraints of Arbitrary Differential Ordercited by 5
- 2023NeuBTF: Neural fields for BTF encoding and transfercited by 5
- 2023Real-Time Neural BRDF with Spherically Distributed Primitivescited by 4
- 2023Real-Time Neural Materials using Block-Compressed Featurescited by 4
- 2023Generating Parametric BRDFs from Natural Language Descriptionscited by 3
- 2023MADS: Modulated Auto-Decoding SIREN for time series imputationcited by 3
12 most cited of 28 All 28 (JSON)
- 2026RoomLight: A 2.5D Illumination Prior for Indoor Environments23 Sep 2026
- 2026PIC: Revisiting INR for Image Coding with Fast Encoding and Sub-Millisecond Decoding8 Sep 2026
- 2026RenderFormer-V2: Neural Rendering with Heterogeneous Scene Primitives4 Sep 2026
- 2026A Hybrid Neural-Microfacet BRDF Model for Real-Time Rendering10 Aug 2026
- 20268DNA: 8D Neural Asset Light Transport by Distribution Learning28 Apr 2026
- 2026Generative World Renderer2 Apr 2026
- 2026Lunar-G2R: Geometry-to-Reflectance Learning for High-Fidelity Lunar BRDF Estimation15 Jan 2026
- 2025FACT-GS: Frequency-Aligned Complexity-Aware Texture Reparameterization for 2D Gaussian Splatting28 Nov 2025
- 2025FreNBRDF: A Frequency-Rectified Neural Material Representation1 Jul 2025
- 2025GratNet: A Photorealistic Neural Shader for Diffractive Surfaces18 Jun 2025
- 2025Neural BRDF Importance Sampling by Reparameterization13 May 2025
- 2025On Neural BRDFs: A Thorough Comparison of State-of-the-Art Approaches21 Feb 2025
12 newest of 28 All 28 (JSON)