mlsanityData to 7 Oct 2026

Filterless Snapshot Hyperspectral Imaging using Guided Patch Diffusion

arXiv 2412.02798 ↗First posted 3 Dec 2024cs.CV eess.IV physics.opticscited by 1

Not on the map. Why?

Abstract (arXiv)

We consider the problem of reconstructing a HxWx31 hyperspectral image from a H× W grayscale snapshot measurement that is captured using only a single diffractive lens and a filterless panchromatic photosensor. This problem is severely ill-posed, but we present a model that produces high-quality results in simulation and experiment. We make efficient use of limited training data by creating a conditional denoising diffusion model that operates on small patches in a shift-invariant manner. During inference, we synchronize per-patch hyperspectral predictions using guidance by physical consistency with the system's optical point spread function. Our experiments reveal that the patch size can be as small as the point spread function, with local optical cues being the main source of information about complete spectra. Also, by drawing multiple samples, our model provides per-pixel uncertainty estimates that strongly correlate with reconstruction error.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 59 references that are in the map. First posted on arXiv 3 Dec 2024.

Builds on

31 of 59 references.

References · 31

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  5. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  6. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  7. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  8. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  9. 2016Training Deep Nets with Sublinear Memory Costcited by 825
  10. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  11. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
  12. 2023Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Modelscited by 131
19 more
  1. 2021Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstructioncited by 110
  2. 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstructioncited by 72
  3. 2022HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imagingcited by 66
  4. 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
  5. 2021Deep Gaussian Scale Mixture Prior for Spectral Compressive Imagingcited by 58
  6. 2024HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Modelscited by 38
  7. 2022Spatial-Spectral Transformer for Hyperspectral Image Denoisingcited by 34
  8. 2023SpectralDiff: A Generative Framework for Hyperspectral Image Classification with Diffusion Modelscited by 28
  9. 2020Spectral DiffuserCam: lensless snapshot hyperspectral imaging with a spectral filter arraycited by 24
  10. 2024Learning Image Priors through Patch-based Diffusion Models for Solving Inverse Problemscited by 18
  11. 2024IntLoRA: Integral Low-rank Adaptation of Quantized Diffusion Modelscited by 9
  12. 2023In2SET: Intra-Inter Similarity Exploiting Transformer for Dual-Camera Compressive Hyperspectral Imagingcited by 8
  13. 2024Patch-Based Diffusion Models Beat Whole-Image Models for Mismatched Distribution Inverse Problemscited by 8
  14. 2023Aperture Diffraction for Compact Snapshot Spectral Imagingcited by 7
  15. 2023DiffSCI: Zero-Shot Snapshot Compressive Imaging via Iterative Spectral Diffusion Modelcited by 6
  16. 2024Limitations of Data-Driven Spectral Reconstruction -- An Optics-Aware Analysiscited by 5
  17. 2024Multistable Shape from Shading Emerges from Patch Diffusioncited by 5
  18. 2023Polarization Multi-Image Synthesis with Birefringent Metasurfacescited by 3
  19. 2022End-to-end joint optimization of metasurface and image processing for compact snapshot hyperspectral imagingcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurementscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Diffusion model for gradient preconditioning in hyperspectral imaging inverse problems
  2. 2026Sensor-Adaptive Infrared Spectral Reconstruction with Plug-and-Play Diffusion Priors
  3. 2026R2H-Diff: Guided Spectral Diffusion Model for RGB-to-Hyperspectral Reconstruction
  4. 2025Learning Spectral Diffusion Prior for Hyperspectral Image Reconstruction
  5. 2026HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation
  6. 2025Hyperspectral Image Generation with Unmixing Guided Diffusion Model
  7. 2026Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening
  8. 2023A Spectral Diffusion Prior for Hyperspectral Image Super-Resolution