mlsanityData to 7 Oct 2026

Deep Polarization Imaging for 3D shape and SVBRDF Acquisition

arXiv 2105.02875 ↗First posted 6 May 2021cs.CV cs.GR cs.LGcited by 56

Not on the map. Why?

Abstract (arXiv)

We present a novel method for efficient acquisition of shape and spatially varying reflectance of 3D objects using polarization cues. Unlike previous works that have exploited polarization to estimate material or object appearance under certain constraints (known shape or multiview acquisition), we lift such restrictions by coupling polarization imaging with deep learning to achieve high quality estimate of 3D object shape (surface normals and depth) and SVBRDF using single-view polarization imaging under frontal flash illumination. In addition to acquired polarization images, we provide our deep network with strong novel cues related to shape and reflectance, in the form of a normalized Stokes map and an estimate of diffuse color. We additionally describe modifications to network architecture and training loss which provide further qualitative improvements. We demonstrate our approach to achieve superior results compared to recent works employing deep learning in conjunction with flash illumination.

Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). Builds on 9 of its 47 references that are in the map. First posted on arXiv 6 May 2021.

Builds on

9 of 47 references.

References · 9

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2018Single-Image SVBRDF Capture with a Rendering-Aware Deep Networkcited by 116
  3. 2018Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Imagecited by 66
  4. 2020Two-shot Spatially-varying BRDF and Shape Estimationcited by 59
  5. 2018Modeling Surface Appearance from a Single Photograph using Self-augmented Convolutional Neural Networkscited by 51
  6. 2019Flexible SVBRDF Capture with a Multi-Image Deep Networkcited by 50
  7. 2018LIME: Live Intrinsic Material Estimationcited by 33
  8. 2020Polarimetric Multi-View Inverse Renderingcited by 28
  9. 2020Guided Fine-Tuning for Large-Scale Material Transfercited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 8; 2023: 10; 2024: 15; 2025: 6; 2026: 15.

56 papers.

Sort:

By area:

  1. 2021Shape from Polarization for Complex Scenes in the Wildcited by 53
  2. 2022PANDORA: Polarization-Aided Neural Decomposition Of Radiancecited by 52
  3. 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Modelscited by 50
  4. 2024MatSynth: A Modern PBR Materials Datasetcited by 42
  5. 2023Material Palette: Extraction of Materials from a Single Imagecited by 28
  6. 2023Materialistic: Selecting Similar Materials in Imagescited by 26
  7. 2023NeISF: Neural Incident Stokes Field for Geometry and Material Estimationcited by 25
  8. 2022High-Res Facial Appearance Capture from Polarized Smartphone Imagescited by 21
  9. 2022Transparent Shape from a Single View Polarization Imagecited by 16
  10. 2023UMat: Uncertainty-Aware Single Image High Resolution Material Capturecited by 11
  11. 2022Polarization Multiplexed Diffractive Computing: All-Optical Implementation of a Group of Linear Transformations Through a Polarization-Encoded Diffractive Networkcited by 10
  12. 2022Simultaneous Acquisition of High Quality RGB Image and Polarization Information using a Sparse Polarization Sensorcited by 9
38 more
  1. 2023Inverse Rendering of Translucent Objects using Physical and Neural Rendererscited by 9
  2. 2023Neural Spectro-polarimetric Fieldscited by 9
  3. 2024NeISF++: Neural Incident Stokes Field for Polarized Inverse Rendering of Conductors and Dielectricscited by 9
  4. 2022Polarimetric Inverse Rendering for Transparent Shapes Reconstructioncited by 8
  5. 2023Spectral and Polarization Vision: Spectro-polarimetric Real-world Datasetcited by 8
  6. 2025PolGS: Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstructioncited by 8
  7. 2022Sparse Ellipsometry: Portable Acquisition of Polarimetric SVBRDF and Shape with Unstructured Flash Photographycited by 7
  8. 2024Polarization Wavefront Lidar: Learning Large Scene Reconstruction from Polarized Wavefrontscited by 7
  9. 2024Robust Depth Enhancement via Polarization Prompt Fusion Tuningcited by 6
  10. 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assetscited by 6
  11. 2024Deep Polarization Cues for Single-shot Shape and Subsurface Scattering Estimationcited by 6
  12. 2024Learning to Deblur Polarized Imagescited by 5
  13. 2021Polarimetric Spatio-Temporal Light Transport Probingcited by 4
  14. 2023Differentiable Display Photometric Stereocited by 4
  15. 2024Uncertainty for SVBRDF Acquisition using Frequency Analysiscited by 4
  16. 2025A Real-world Display Inverse Rendering Datasetcited by 4
  17. 2024SS-SfP:Neural Inverse Rendering for Self Supervised Shape from (Mixed) Polarizationcited by 3
  18. 2024Polarimetric BSSRDF Acquisition of Dynamic Facescited by 3
  19. 2025Benchmarking Burst Super-Resolution for Polarization Images: Noise Dataset and Analysiscited by 3
  20. 2023Fooling Polarization-based Vision using Locally Controllable Polarizing Projectioncited by 2
  21. 2024NeST: Neural Stress Tensor Tomography by leveraging 3D Photoelasticitycited by 2
  22. 2025MaRI: Material Retrieval Integration across Domainscited by 2
  23. 2022Polarized Color Image Denoising using Pocoformercited by 1
  24. 2023Pola4All: survey of polarimetric applications and an open-source toolkit to analyze polarizationcited by 1
  25. 2024High Resolution Surface Reconstruction of Cultural Heritage Objects Using Shape from Polarization Methodcited by 1
  26. 2026Architectural Unification for Polarimetric Imaging Across Multiple Degradationscited by 1
  27. 2026PolarAPP: Beyond Polarization Demosaicking for Polarimetric Applicationscited by 1
  28. 2026PolarVSR: A Unified Framework and Benchmark for Continuous Space-Time Polarization Video Reconstructioncited by 1
  29. 2024LookUp3D: Data-Driven 3D Scanningcited by 0
  30. 2024Surface Normal Reconstruction Using Polarization-Unetcited by 0
  31. 2025Spatial Polarization Multiplexing: Single-Shot Invisible Shape and Reflectance Recoverycited by 0
  32. 2025An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenescited by 0
  33. 2026Segmentation-Driven Monocular Shape from Polarization based on Physical Modelcited by 0
  34. 2026Revisiting Shape from Polarization in the Era of Vision Foundation Modelscited by 0
  35. 2026PolGS++: Physically-Guided Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstructioncited by 0
  36. 2026PhyGaP: Physically-Grounded Gaussians with Polarization Cuescited by 0
  37. 2026A Lensless Polarization Cameracited by 0
  38. 2026Poppy: Polarization-based Plug-and-Play Guidance for Enhancing Monocular Normal Estimationcited by 0

50 most cited of 56 All 56 (JSON)