# Latent Diffusion Prior Enhanced Deep Unfolding for Snapshot Spectral Compressive Imaging

arXiv: https://arxiv.org/abs/2311.14280 · HTML: https://mlsanity.com/paper/2311.14280/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models.
- Builds on 10 of its 76 references that are in the map.
- First posted on arXiv 24 Nov 2023.

## Placed in

- Diffusion models / [Inverse problems and image restoration](https://mlsanity.com/diffusion/inverse-problems-and-image-restoration/)

## Builds on (most cited first, 10 of 10)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Denoising Diffusion Implicit Models](https://mlsanity.com/paper/2010.02502/) (2020)
- [Auto-Encoding Variational Bayes](https://mlsanity.com/paper/1312.6114/) (2013)
- [Gaussian Error Linear Units (GELUs)](https://mlsanity.com/paper/1606.08415/) (2016)
- [Imagen Video: High Definition Video Generation with Diffusion Models](https://mlsanity.com/paper/2210.02303/) (2022)
- [Fast Sampling of Diffusion Models with Exponential Integrator](https://mlsanity.com/paper/2204.13902/) (2022)
- [DiffIR: Efficient Diffusion Model for Image Restoration](https://mlsanity.com/paper/2303.09472/) (2023)
- [Diffusion Models for Video Prediction and Infilling](https://mlsanity.com/paper/2206.07696/) (2022)
- [Hierarchical Integration Diffusion Model for Realistic Image Deblurring](https://mlsanity.com/paper/2305.12966/) (2023)
- [GAP-net for Snapshot Compressive Imaging](https://mlsanity.com/paper/2012.08364/) (2020)

## Built on by (most cited first, 7 of 7)

- [Leveraging Diffusion Knowledge for Generative Image Compression with Fractal Frequency-Aware Band Learning](https://mlsanity.com/paper/2503.11321/) (2025)
- [Spectral Compressive Imaging via Chromaticity-Intensity Decomposition](https://mlsanity.com/paper/2509.16690/) (2025)
- [LRDUN: A Low-Rank Deep Unfolding Network for Efficient Spectral Compressive Imaging](https://mlsanity.com/paper/2511.18513/) (2025)
- [Flow-Matching Guided Deep Unfolding for Hyperspectral Image Reconstruction](https://mlsanity.com/paper/2510.01912/) (2025)
- [Hierarchical Spatial-Frequency Aggregation for Spectral Deconvolution Imaging](https://mlsanity.com/paper/2511.06751/) (2025)
- [Exploring Spatiotemporal Feature Propagation for Video-Level Compressive Spectral Reconstruction: Dataset, Model and Benchmark](https://mlsanity.com/paper/2603.00611/) (2026)
- [Phy-CoSF: Physics-Guided Continuous Spectral Fields Reconstruction and Super-Resolution for Snapshot Compressive Imaging](https://mlsanity.com/paper/2605.13583/) (2026)

## Abstract (arXiv)

Snapshot compressive spectral imaging reconstruction aims to reconstruct three-dimensional spatial-spectral images from a single-shot two-dimensional compressed measurement. Existing state-of-the-art methods are mostly based on deep unfolding structures but have intrinsic performance bottlenecks: i) the ill-posed problem of dealing with heavily degraded measurement, and ii) the regression loss-based reconstruction models being prone to recover images with few details. In this paper, we introduce a generative model, namely the latent diffusion model (LDM), to generate degradation-free prior to enhance the regression-based deep unfolding method. Furthermore, to overcome the large computational cost challenge in LDM, we propose a lightweight model to generate knowledge priors in deep unfolding denoiser, and integrate these priors to guide the reconstruction process for compensating high-quality spectral signal details. Numeric and visual comparisons on synthetic and real-world datasets illustrate the superiority of our proposed method in both reconstruction quality and computational efficiency. Code will be released.
