mlsanityData to 7 Oct 2026

Stokes-Informed Diffusion for Robust Linear Polarization Estimation

arXiv 2607.21239 ↗First posted 23 Jul 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Polarization cues benefit applications such as material detection and de-reflection, yet acquiring them typically requires dedicated hardware. This motivates us to estimate the linear polarization from a single RGB image. However, the task is inherently ill-posed, with the Angle of Polarization (AoP) becoming particularly unstable in weak polarization regions, where the polarimetric signal is overwhelmed by noise, leading to erratic angle estimates. To address these limitations, we propose GenPolar, a Stokes-informed diffusion framework grounded in the Mueller formalism from an intensity observation. Specifically, GenPolar predicts channel-wise linear Stokes components (S1,S2) from intensity S0, from which degree of linear polarization (DoLP) and AoP are analytically derived; AoP is further supervised with an observability-aware loss. In addition, to enable efficient and high-fidelity inference, we adopt a two-stage training strategy. Firstly, a multi-step conditional diffusion model is trained with a physics-based loss. Subsequently, we distill it into a one-step generator, which further supports stable Low-Rank Adaptation (LoRA) of the VAE encoder to mitigate domain-specific autoencoding bias. Extensive experiments across rotating-polarizer, division-of-focal-plane, and hybrid datasets demonstrate that GenPolar achieves state-of-the-art performance in both DoLP fidelity and AoP stability. Crucially, these improvements translate to significant and consistent gains in downstream applications, including material detection and de-reflection.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 45 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

16 of 45 references.

References · 16

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  5. 2020Polarized Reflection Removal with Perfect Alignment in the Wildcited by 69
  6. 2021Shape from Polarization for Complex Scenes in the Wildcited by 53
  7. 2023NeISF: Neural Incident Stokes Field for Geometry and Material Estimationcited by 25
  8. 2020Polarization-driven Semantic Segmentation via Efficient Attention-bridged Fusioncited by 23
  9. 2025PolarFree: Polarization-based Reflection-free Imagingcited by 18
  10. 2025PIDSR: Complementary Polarized Image Demosaicing and Super-Resolutioncited by 11
  11. 2022Simultaneous Acquisition of High Quality RGB Image and Polarization Information using a Sparse Polarization Sensorcited by 9
  12. 2023Spectral and Polarization Vision: Spectro-polarimetric Real-world Datasetcited by 8
4 more
  1. 2025RGB-to-Polarization Estimation: A New Task and Benchmark Studycited by 6
  2. 2025PolarAnything: Diffusion-based Polarimetric Image Synthesiscited by 5
  3. 2025Polarization Denoising and Demosaicking: Dataset and Baseline Methodcited by 5
  4. 2026Polarization Uncertainty-Guided Diffusion Model for Color Polarization Image Demosaickingcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026PolarScale: A Physics-Grounded Benchmark for Radiometrically Consistent RGB-to-Stokes Estimation
  2. 2025Diffusion-based Virtual Staining from Polarimetric Mueller Matrix Imaging
  3. 2025POLARIS: Projection-Orthogonal Least Squares for Robust and Adaptive Inversion in Diffusion Models
  4. 2026Spectral Collapse in Diffusion Inversion
  5. 2024MatFusion: A Generative Diffusion Model for SVBRDF Capture
  6. 2026Analyzing and Guiding Zero-Shot Posterior Sampling in Diffusion Models
  7. 2025Preserving Spectral Structure and Statistics in Diffusion Models
  8. 2024Leveraging Multimodal Diffusion Models to Accelerate Imaging with Side Information