# Polarimetric Multi-View Inverse Rendering

arXiv: https://arxiv.org/abs/2007.08830 · HTML: https://mlsanity.com/paper/2007.08830/

## Key facts

- Cited by 28 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 17 Jul 2020.

## Built on by (most cited first, 28 of 28)

- [Deep Polarization Imaging for 3D shape and SVBRDF Acquisition](https://mlsanity.com/paper/2105.02875/) (2021)
- [Shape from Polarization for Complex Scenes in the Wild](https://mlsanity.com/paper/2112.11377/) (2021)
- [PANDORA: Polarization-Aided Neural Decomposition Of Radiance](https://mlsanity.com/paper/2203.13458/) (2022)
- [NeISF: Neural Incident Stokes Field for Geometry and Material Estimation](https://mlsanity.com/paper/2311.13187/) (2023)
- [NeRSP: Neural 3D Reconstruction for Reflective Objects with Sparse Polarized Images](https://mlsanity.com/paper/2406.07111/) (2024)
- [Multi-View Azimuth Stereo via Tangent Space Consistency](https://mlsanity.com/paper/2303.16447/) (2023)
- [PISR: Polarimetric Neural Implicit Surface Reconstruction for Textureless and Specular Objects](https://mlsanity.com/paper/2409.14331/) (2024)
- [Perspective Phase Angle Model for Polarimetric 3D Reconstruction](https://mlsanity.com/paper/2207.09629/) (2022)
- [Two-Step Color-Polarization Demosaicking Network](https://mlsanity.com/paper/2209.06027/) (2022)
- [Simultaneous Acquisition of High Quality RGB Image and Polarization Information using a Sparse Polarization Sensor](https://mlsanity.com/paper/2209.13106/) (2022)
- [NeISF++: Neural Incident Stokes Field for Polarized Inverse Rendering of Conductors and Dielectrics](https://mlsanity.com/paper/2411.10189/) (2024)
- [Spectral MVIR: Joint Reconstruction of 3D Shape and Spectral Reflectance](https://mlsanity.com/paper/2104.07308/) (2021)
- [Polarimetric Inverse Rendering for Transparent Shapes Reconstruction](https://mlsanity.com/paper/2208.11836/) (2022)
- [PolGS: Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction](https://mlsanity.com/paper/2509.19726/) (2025)
- [Sparse Ellipsometry: Portable Acquisition of Polarimetric SVBRDF and Shape with Unstructured Flash Photography](https://mlsanity.com/paper/2207.04236/) (2022)
- [Deep Polarization Cues for Single-shot Shape and Subsurface Scattering Estimation](https://mlsanity.com/paper/2407.08149/) (2024)
- [Deep Demosaicing for Polarimetric Filter Array Cameras](https://mlsanity.com/paper/2211.13732/) (2022)
- [GNeRP: Gaussian-guided Neural Reconstruction of Reflective Objects with Noisy Polarization Priors](https://mlsanity.com/paper/2403.11899/) (2024)
- [PolarAnything: Diffusion-based Polarimetric Image Synthesis](https://mlsanity.com/paper/2507.17268/) (2025)
- [Polarimetric PatchMatch Multi-View Stereo](https://mlsanity.com/paper/2311.07600/) (2023)
- [Polarimetric BSSRDF Acquisition of Dynamic Faces](https://mlsanity.com/paper/2501.01980/) (2024)
- [Benchmarking Burst Super-Resolution for Polarization Images: Noise Dataset and Analysis](https://mlsanity.com/paper/2503.18705/) (2025)
- [Glossy Object Reconstruction with Cost-effective Polarized Acquisition](https://mlsanity.com/paper/2504.07025/) (2025)
- [Fooling Polarization-based Vision using Locally Controllable Polarizing Projection](https://mlsanity.com/paper/2303.17890/) (2023)
- [Thermal Polarimetric Multi-view Stereo](https://mlsanity.com/paper/2510.20972/) (2025)
- [Pola4All: survey of polarimetric applications and an open-source toolkit to analyze polarization](https://mlsanity.com/paper/2312.14697/) (2023)
- [A Geometric Model for Polarization Imaging on Projective Cameras](https://mlsanity.com/paper/2211.16986/) (2022)
- [PhyGaP: Physically-Grounded Gaussians with Polarization Cues](https://mlsanity.com/paper/2603.14001/) (2026)

## Abstract (arXiv)

A polarization camera has great potential for 3D reconstruction since the angle of polarization (AoP) of reflected light is related to an object's surface normal. In this paper, we propose a novel 3D reconstruction method called Polarimetric Multi-View Inverse Rendering (Polarimetric MVIR) that effectively exploits geometric, photometric, and polarimetric cues extracted from input multi-view color polarization images. We first estimate camera poses and an initial 3D model by geometric reconstruction with a standard structure-from-motion and multi-view stereo pipeline. We then refine the initial model by optimizing photometric and polarimetric rendering errors using multi-view RGB and AoP images, where we propose a novel polarimetric rendering cost function that enables us to effectively constrain each estimated surface vertex's normal while considering four possible ambiguous azimuth angles revealed from the AoP measurement. Experimental results using both synthetic and real data demonstrate that our Polarimetric MVIR can reconstruct a detailed 3D shape without assuming a specific polarized reflection depending on the material.