SurfaceNet: Adversarial SVBRDF Estimation from a Single Image
Not on the map. Why?
Abstract (arXiv)
In this paper we present SurfaceNet, an approach for estimating spatially-varying bidirectional reflectance distribution function (SVBRDF) material properties from a single image. We pose the problem as an image translation task and propose a novel patch-based generative adversarial network (GAN) that is able to produce high-quality, high-resolution surface reflectance maps. The employment of the GAN paradigm has a twofold objective: 1) allowing the model to recover finer details than standard translation models; 2) reducing the domain shift between synthetic and real data distributions in an unsupervised way. An extensive evaluation, carried out on a public benchmark of synthetic and real images under different illumination conditions, shows that SurfaceNet largely outperforms existing SVBRDF reconstruction methods, both quantitatively and qualitatively. Furthermore, SurfaceNet exhibits a remarkable ability in generating high-quality maps from real samples without any supervision at training time.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 14 of its 27 references that are in the map. First posted on arXiv 23 Jul 2021.
Builds on
14 of 27 references.
References · 14
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2013Describing Textures in the Wildcited by 2,110
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2018Single-Image SVBRDF Capture with a Rendering-Aware Deep Networkcited by 116
- 2018Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Imagecited by 66
- 2020Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Imagescited by 65
- 2018Modeling Surface Appearance from a Single Photograph using Self-augmented Convolutional Neural Networkscited by 51
- 2019Flexible SVBRDF Capture with a Multi-Image Deep Networkcited by 50
- 2015Loss Functions for Neural Networks for Image Processingcited by 41
2 more
- 2020MaterialGAN: Reflectance Capture using a Generative SVBRDF Modelcited by 33
- 2020Guided Fine-Tuning for Large-Scale Material Transfercited by 27
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 7; 2025: 11; 2026: 1.
25 papers.
Sort:
By area:
- 2022Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptationcited by 67
- 2023ControlMat: A Controlled Generative Approach to Material Capturecited by 50
- 2024MatSynth: A Modern PBR Materials Datasetcited by 42
- 2023MatFuse: Controllable Material Generation with Diffusion Modelscited by 39
- 2024MatFusion: A Generative Diffusion Model for SVBRDF Capturecited by 31
- 2023Material Palette: Extraction of Materials from a Single Imagecited by 28
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capturecited by 11
- 2025VLMaterial: Procedural Material Generation with Large Vision-Language Modelscited by 9
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assetscited by 6
- 2024ReflectanceFusion: Diffusion-based text to SVBRDF Generationcited by 5
- 2025Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Imagescited by 5
- 2024StableMaterials: Enhancing Diversity in Material Generation via Semi-Supervised Learningcited by 4
13 more
- 2025MatPedia: A Universal Generative Foundation for High-Fidelity Material Synthesiscited by 3
- 2025MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Modelscited by 2
- 2024FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Clothing Imagescited by 1
- 2025Single-image Reflectance and Transmittance Estimation from Any Flatbed Scannercited by 1
- 2025RETRO: REthinking Tactile Representation Learning with Material PriOrscited by 1
- 2025DualMat: PBR Material Estimation via Coherent Dual-Path Diffusioncited by 1
- 2025Yesnt: Are Diffusion Relighting Models Ready for Capture Stage Compositing? A Hybrid Alternative to Bridge the Gapcited by 1
- 2022Diffuse Map Guiding Unsupervised Generative Adversarial Network for SVBRDF Estimationcited by 0
- 2024Neural Appearance Modeling From Single Imagescited by 0
- 2025Design of an Expression Recognition Solution Based on the Global Channel-Spatial Attention Mechanism and Proportional Criterion Fusioncited by 0
- 2025SpecGen: Neural Spectral BRDF Generation via Spectral-Spatial Tri-plane Aggregationcited by 0
- 2025Phieat: Physically Grounded Material Feature Representationcited by 0
- 2026DealMaTe: Multi-Dimensional Material Transfer via Diffusion Transformercited by 0
- 2026DealMaTe: Multi-Dimensional Material Transfer via Diffusion Transformer15 May 2026
- 2025MatPedia: A Universal Generative Foundation for High-Fidelity Material Synthesis21 Nov 2025
- 2025Phieat: Physically Grounded Material Feature Representation14 Nov 2025
- 2025Yesnt: Are Diffusion Relighting Models Ready for Capture Stage Compositing? A Hybrid Alternative to Bridge the Gap27 Oct 2025
- 2025Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Images12 Sep 2025
- 2025SpecGen: Neural Spectral BRDF Generation via Spectral-Spatial Tri-plane Aggregation24 Aug 2025
- 2025DualMat: PBR Material Estimation via Coherent Dual-Path Diffusion7 Aug 2025
- 2025RETRO: REthinking Tactile Representation Learning with Material PriOrs20 May 2025
- 2025Design of an Expression Recognition Solution Based on the Global Channel-Spatial Attention Mechanism and Proportional Criterion Fusion15 Mar 2025
- 2025Single-image Reflectance and Transmittance Estimation from Any Flatbed Scanner20 Feb 2025
- 2025VLMaterial: Procedural Material Generation with Large Vision-Language Models27 Jan 2025
- 2025MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Models27 Jan 2025
13 more
- 2024FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Clothing Images2 Oct 2024
- 2024StableMaterials: Enhancing Diversity in Material Generation via Semi-Supervised Learning13 Jun 2024
- 2024Neural Appearance Modeling From Single Images8 Jun 2024
- 2024ReflectanceFusion: Diffusion-based text to SVBRDF Generation25 Apr 2024
- 2024MatFusion: A Generative Diffusion Model for SVBRDF Capture24 Apr 2024
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assets22 Apr 2024
- 2024MatSynth: A Modern PBR Materials Dataset11 Jan 2024
- 2023Material Palette: Extraction of Materials from a Single Image28 Nov 2023
- 2023ControlMat: A Controlled Generative Approach to Material Capture4 Sep 2023
- 2023MatFuse: Controllable Material Generation with Diffusion Models22 Aug 2023
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capture25 May 2023
- 2022Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptation21 Sep 2022
- 2022Diffuse Map Guiding Unsupervised Generative Adversarial Network for SVBRDF Estimation24 May 2022
- 2023ControlMat: A Controlled Generative Approach to Material Capturecited by 50
- 2023MatFuse: Controllable Material Generation with Diffusion Modelscited by 39
- 2024MatFusion: A Generative Diffusion Model for SVBRDF Capturecited by 31
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assetscited by 6
- 2024ReflectanceFusion: Diffusion-based text to SVBRDF Generationcited by 5
- 2025Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Imagescited by 5
- 2024StableMaterials: Enhancing Diversity in Material Generation via Semi-Supervised Learningcited by 4
- 2025Yesnt: Are Diffusion Relighting Models Ready for Capture Stage Compositing? A Hybrid Alternative to Bridge the Gapcited by 1
- 2026DealMaTe: Multi-Dimensional Material Transfer via Diffusion Transformercited by 0
- 2026DealMaTe: Multi-Dimensional Material Transfer via Diffusion Transformer15 May 2026
- 2025Yesnt: Are Diffusion Relighting Models Ready for Capture Stage Compositing? A Hybrid Alternative to Bridge the Gap27 Oct 2025
- 2025Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Images12 Sep 2025
- 2024StableMaterials: Enhancing Diversity in Material Generation via Semi-Supervised Learning13 Jun 2024
- 2024ReflectanceFusion: Diffusion-based text to SVBRDF Generation25 Apr 2024
- 2024MatFusion: A Generative Diffusion Model for SVBRDF Capture24 Apr 2024
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assets22 Apr 2024
- 2023ControlMat: A Controlled Generative Approach to Material Capture4 Sep 2023
- 2023MatFuse: Controllable Material Generation with Diffusion Models22 Aug 2023
- 2022Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptationcited by 67
- 2024MatSynth: A Modern PBR Materials Datasetcited by 42
- 2023Material Palette: Extraction of Materials from a Single Imagecited by 28
- 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capturecited by 11
- 2025MatPedia: A Universal Generative Foundation for High-Fidelity Material Synthesiscited by 3
- 2025MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Modelscited by 2
- 2024FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Clothing Imagescited by 1
- 2025Single-image Reflectance and Transmittance Estimation from Any Flatbed Scannercited by 1
- 2025RETRO: REthinking Tactile Representation Learning with Material PriOrscited by 1
- 2025DualMat: PBR Material Estimation via Coherent Dual-Path Diffusioncited by 1
- 2022Diffuse Map Guiding Unsupervised Generative Adversarial Network for SVBRDF Estimationcited by 0
- 2024Neural Appearance Modeling From Single Imagescited by 0
12 most cited of 15 All 15 (JSON)
- 2025MatPedia: A Universal Generative Foundation for High-Fidelity Material Synthesis21 Nov 2025
- 2025Phieat: Physically Grounded Material Feature Representation14 Nov 2025
- 2025SpecGen: Neural Spectral BRDF Generation via Spectral-Spatial Tri-plane Aggregation24 Aug 2025
- 2025DualMat: PBR Material Estimation via Coherent Dual-Path Diffusion7 Aug 2025
- 2025RETRO: REthinking Tactile Representation Learning with Material PriOrs20 May 2025
- 2025Design of an Expression Recognition Solution Based on the Global Channel-Spatial Attention Mechanism and Proportional Criterion Fusion15 Mar 2025
- 2025Single-image Reflectance and Transmittance Estimation from Any Flatbed Scanner20 Feb 2025
- 2025MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Models27 Jan 2025
- 2024FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Clothing Images2 Oct 2024
- 2024Neural Appearance Modeling From Single Images8 Jun 2024
- 2024MatSynth: A Modern PBR Materials Dataset11 Jan 2024
- 2023Material Palette: Extraction of Materials from a Single Image28 Nov 2023
12 newest of 15 All 15 (JSON)