A Deep Unfolding Framework for Diffractive Snapshot Spectral Imaging
Not on the map. Why?
Abstract (arXiv)
Snapshot hyperspectral imaging systems acquire spectral data cubes through compressed sensing. Recently, diffractive snapshot spectral imaging (DSSI) methods have attracted significant attention. While various optical designs and improvements continue to emerge, research on reconstruction algorithms remains limited. Although numerous networks and deep unfolding methods have been applied on similar tasks, they are not fully compatible with DSSI systems because of their distinct optical encoding mechanism. In this paper, we propose an efficient deep unfolding framework for diffractive systems, termed diffractive deep unfolding (DDU). Specifically, we derive an analytical solution for the data fidelity term in DSSI, ensuring both the efficiency and the effectiveness during the iterative reconstruction process. Given the severely ill-posed nature of the problem, we employ a network-based initialization strategy rather than non-learning-based methods or linear layers, leading to enhanced stability and performance. Our framework demonstrates strong compatibility with existing state-of-the-art (SOTA) models, which effectively address the initialization and prior subproblem. Extensive experiments validate the superiority of the proposed DDU framework, showcasing improved performance while maintaining comparable parameter counts and computational complexity. These results suggest that DDU provides a solid foundation for future unfolding-based methods in DSSI.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 45 references that are in the map. First posted on arXiv 7 Jul 2025.
Builds on
17 of 45 references.
References · 17
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
- 2020Deep Unfolding Network for Image Super-Resolutioncited by 254
- 2016Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applicationscited by 246
- 2022Learning Enriched Features for Fast Image Restoration and Enhancementcited by 150
- 2021Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstructioncited by 110
- 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstructioncited by 72
- 2022HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imagingcited by 66
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
- 2020Single-shot Hyperspectral-Depth Imaging with Learned Diffractive Opticscited by 39
- 2018Material Based Object Tracking in Hyperspectral Videos: Benchmark and Algorithmscited by 36
5 more
- 2020NTIRE 2020 Challenge on Spectral Reconstruction from an RGB Imagecited by 30
- 2020Hierarchical Regression Network for Spectral Reconstruction from RGB Imagescited by 29
- 2020AdaptiveWeighted Attention Network with Camera Spectral Sensitivity Prior for Spectral Reconstruction from RGB Imagescited by 29
- 2023Dynamic Path-Controllable Deep Unfolding Network for Compressive Sensingcited by 15
- 2023Aperture Diffraction for Compact Snapshot Spectral Imagingcited by 7
Built on by
Not cited yet.