mlsanityData to 14 Oct 2026

Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurements

arXiv 2511.18473 ↗First posted 23 Nov 2025cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Hyperspectral image reconstruction from a compressed measurement is a highly ill-posed inverse problem. Current data-driven methods suffer from hallucination due to the lack of spectral diversity in existing hyperspectral image datasets, particularly when they are evaluated for the metamerism phenomenon. In this work, we formulate hyperspectral image (HSI) reconstruction as a Bayesian inference problem and propose a framework, HSDiff, that utilizes an unconditionally trained, pixel-level diffusion prior and posterior diffusion sampling to generate diverse HSI samples consistent with the measurements of various hyperspectral image formation models. We propose an enhanced metameric augmentation technique using region-based metameric black and partition-of-union spectral upsampling to expand training with physically valid metameric spectra, strengthening the prior diversity and improving uncertainty calibration. We utilize HSDiff to investigate how the studied forward models shape the posterior distribution and demonstrate that guiding with effective spectral encoding provides calibrated informative uncertainty compared to non-encoded models. Through the lens of the Bayesian framework, HSDiff offers a complete, high-performance method for uncertainty-aware HSI reconstruction. Our results also reiterate the significance of effective spectral encoding in snapshot hyperspectral imaging.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 29 of its 57 references that are in the map. First posted on arXiv 23 Nov 2025.

Builds on

29 of 57 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025InverseBench: Benchmarking Plug-and-Play Diffusion Priors for Inverse Problems in Physical Sciences14 Mar
  2. 2025Geophysical inverse problems with measurement-guided diffusion models8 Jan
  3. 2024A Survey on Diffusion Models for Inverse Problems30 Sep
  4. 2024Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors29 May
  5. 2024Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction25 Mar
  6. 2024Diffusion Posterior Proximal Sampling for Image Restoration25 Feb
  7. 2024HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models24 Feb
  8. 2023HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models21 Jun
  9. 2023SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Models12 Apr
  10. 2022DOLPH: Diffusion Models for Phase Retrieval1 Nov
  11. 2022Diffusion Posterior Sampling for General Noisy Inverse Problems29 Sep
  12. 2021Deblurring via Stochastic Refinement5 Dec
1 more
  1. 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models30 Apr

Other references · 16

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2022Generative Adversarial Networkscited by 5,627
  5. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  8. 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstructioncited by 72
  9. 2021A survey on computational spectral reconstruction methods from RGB to hyperspectral imagingcited by 20
  10. 2018Hyperspectral recovery from RGB images using Gaussian Processescited by 13
  11. 2025Multimodal Atmospheric Super-Resolution With Deep Generative Modelscited by 8
  12. 2024Limitations of Data-Driven Spectral Reconstruction -- An Optics-Aware Analysiscited by 5
4 more
  1. 2021Deep-learning-based Hyperspectral imaging through a RGB cameracited by 2
  2. 2023One-to-Many Spectral Upsampling of Reflectances and Transmittancescited by 2
  3. 2024Comparative Analysis of Hyperspectral Image Reconstruction Using Deep Learning for Agricultural and Biological Applicationscited by 1
  4. 2024Filterless Snapshot Hyperspectral Imaging using Guided Patch Diffusioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Learning Spectral Diffusion Prior for Hyperspectral Image Reconstruction
  2. 2026R2H-Diff: Guided Spectral Diffusion Model for RGB-to-Hyperspectral Reconstruction
  3. 2026HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation
  4. 2026HSI-VAR: Rethinking Hyperspectral Restoration through Spatial-Spectral Visual Autoregression
  5. 2023A Spectral Diffusion Prior for Hyperspectral Image Super-Resolution
  6. 2023Hyperspectral and Multispectral Image Fusion Using the Conditional Denoising Diffusion Probabilistic Model
  7. 2025Diffusion model for gradient preconditioning in hyperspectral imaging inverse problems
  8. 2025Hyperspectral Image Generation with Unmixing Guided Diffusion Model