HerosNet: Hyperspectral Explicable Reconstruction and Optimal Sampling Deep Network for Snapshot Compressive Imaging
Not on the map. Why?
Abstract (arXiv)
Hyperspectral imaging is an essential imaging modality for a wide range of applications, especially in remote sensing, agriculture, and medicine. Inspired by existing hyperspectral cameras that are either slow, expensive, or bulky, reconstructing hyperspectral images (HSIs) from a low-budget snapshot measurement has drawn wide attention. By mapping a truncated numerical optimization algorithm into a network with a fixed number of phases, recent deep unfolding networks (DUNs) for spectral snapshot compressive sensing (SCI) have achieved remarkable success. However, DUNs are far from reaching the scope of industrial applications limited by the lack of cross-phase feature interaction and adaptive parameter adjustment. In this paper, we propose a novel Hyperspectral Explicable Reconstruction and Optimal Sampling deep Network for SCI, dubbed HerosNet, which includes several phases under the ISTA-unfolding framework. Each phase can flexibly simulate the sensing matrix and contextually adjust the step size in the gradient descent step, and hierarchically fuse and interact the hidden states of previous phases to effectively recover current HSI frames in the proximal mapping step. Simultaneously, a hardware-friendly optimal binary mask is learned end-to-end to further improve the reconstruction performance. Finally, our HerosNet is validated to outperform the state-of-the-art methods on both simulation and real datasets by large margins. The source code is available at https://github.com/jianzhangcs/HerosNet.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 11 of its 56 references that are in the map. First posted on arXiv 12 Dec 2021.
Builds on
11 of 56 references.
References · 11
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018Rank Minimization for Snapshot Compressive Imagingcited by 99
- 2020Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imagingcited by 78
- 2021Deep Gaussian Scale Mixture Prior for Spectral Compressive Imagingcited by 58
- 2020GAP-net for Snapshot Compressive Imagingcited by 54
- 2021ISTA-Net++: Flexible Deep Unfolding Network for Compressive Sensingcited by 39
- 2021Memory-Augmented Deep Unfolding Network for Compressive Sensingcited by 38
- 2021COAST: COntrollable Arbitrary-Sampling NeTwork for Compressive Sensingcited by 32
- 2021Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imagingcited by 31
- 2014Image Compressive Sensing Recovery Using Adaptively Learned Sparsifying Basis via L0 Minimizationcited by 13
- 2020Hyperspectral Super-Resolution via Interpretable Block-Term Tensor Modelingcited by 10
Built on by
Citing papers per year: 2022: 2; 2023: 12; 2024: 7; 2025: 2; 2026: 3.
26 papers.
Sort:
By area:
- 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 109
- 2023Implicit Neural Representation for Cooperative Low-light Image Enhancementcited by 92
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
- 2023Binarized Spectral Compressive Imagingcited by 23
- 2022Residual Degradation Learning Unfolding Framework with Mixing Priors across Spectral and Spatial for Compressive Spectral Imagingcited by 22
- 2023Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstructioncited by 20
- 2023DiffLLE: Diffusion-guided Domain Calibration for Unsupervised Low-light Image Enhancementcited by 8
- 2023Progressive Content-aware Coded Hyperspectral Compressive Imagingcited by 6
- 2024ResVR: Joint Rescaling and Viewport Rendering of Omnidirectional Imagescited by 6
- 2023Dispersed Structured Light for Hyperspectral 3D Imagingcited by 4
- 2024RealOSR: Latent Guidance Boosts Diffusion-based Real-world Omnidirectional Image Super-Resolutionscited by 3
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editingcited by 3
14 more
- 2023Unfolding Framework with Prior of Convolution-Transformer Mixture and Uncertainty Estimation for Video Snapshot Compressive Imagingcited by 2
- 2024Dual Hyperspectral Mamba for Efficient Spectral Compressive Imagingcited by 2
- 2024Exploiting Frequency Correlation for Hyperspectral Image Reconstructioncited by 2
- 2023MLP-AMDC: An MLP Architecture for Adaptive-Mask-based Dual-Camera snapshot hyperspectral imagingcited by 1
- 2024Untrained Neural Nets for Snapshot Compressive Imaging: Theory and Algorithmscited by 1
- 2024Inter and Intra Prior Learning-based Hyperspectral Image Reconstruction Using Snapshot SWIR Metasurfacecited by 1
- 2025LRDUN: A Low-Rank Deep Unfolding Network for Efficient Spectral Compressive Imagingcited by 1
- 2026Deep LoRA-Unfolding Networks for Image Restorationcited by 1
- 2023DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imagingcited by 0
- 2023Computational Spectral Imaging with Unified Encoding Model: A Comparative Study and Beyondcited by 0
- 2023BSS-Bench: Towards Reproducible and Effective Band Selection Searchcited by 0
- 2024Self-Supervised One-Step Diffusion Refinement for Snapshot Compressive Imagingcited by 0
- 2025SlowFast-SCI: Slow-Fast Deep Unfolding Learning for Spectral Compressive Imagingcited by 0
- 2026Aperture-aware Dispersion 5-D Light-field Imaging Spectrometercited by 0
- 2026Aperture-aware Dispersion 5-D Light-field Imaging Spectrometer6 Jul 2026
- 2026Deep LoRA-Unfolding Networks for Image Restoration21 Feb 2026
- 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editing5 Jan 2026
- 2025LRDUN: A Low-Rank Deep Unfolding Network for Efficient Spectral Compressive Imaging23 Nov 2025
- 2025SlowFast-SCI: Slow-Fast Deep Unfolding Learning for Spectral Compressive Imaging20 Sep 2025
- 2024RealOSR: Latent Guidance Boosts Diffusion-based Real-world Omnidirectional Image Super-Resolutions11 Dec 2024
- 2024Self-Supervised One-Step Diffusion Refinement for Snapshot Compressive Imaging11 Sep 2024
- 2024Inter and Intra Prior Learning-based Hyperspectral Image Reconstruction Using Snapshot SWIR Metasurface10 Jul 2024
- 2024Untrained Neural Nets for Snapshot Compressive Imaging: Theory and Algorithms6 Jun 2024
- 2024Exploiting Frequency Correlation for Hyperspectral Image Reconstruction2 Jun 2024
- 2024Dual Hyperspectral Mamba for Efficient Spectral Compressive Imaging1 Jun 2024
- 2024ResVR: Joint Rescaling and Viewport Rendering of Omnidirectional Images25 Apr 2024
14 more
- 2023BSS-Bench: Towards Reproducible and Effective Band Selection Search22 Dec 2023
- 2023Computational Spectral Imaging with Unified Encoding Model: A Comparative Study and Beyond20 Dec 2023
- 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protection12 Dec 2023
- 2023Dispersed Structured Light for Hyperspectral 3D Imaging30 Nov 2023
- 2023MLP-AMDC: An MLP Architecture for Adaptive-Mask-based Dual-Camera snapshot hyperspectral imaging12 Oct 2023
- 2023Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction21 Aug 2023
- 2023DiffLLE: Diffusion-guided Domain Calibration for Unsupervised Low-light Image Enhancement18 Aug 2023
- 2023DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imaging3 Aug 2023
- 2023Unfolding Framework with Prior of Convolution-Transformer Mixture and Uncertainty Estimation for Video Snapshot Compressive Imaging20 Jun 2023
- 2023Binarized Spectral Compressive Imaging17 May 2023
- 2023Implicit Neural Representation for Cooperative Low-light Image Enhancement21 Mar 2023
- 2023Progressive Content-aware Coded Hyperspectral Compressive Imaging17 Mar 2023
- 2022Residual Degradation Learning Unfolding Framework with Mixing Priors across Spectral and Spatial for Compressive Spectral Imaging13 Nov 2022
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging20 May 2022
- 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 109
- 2023Implicit Neural Representation for Cooperative Low-light Image Enhancementcited by 92
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
- 2023Binarized Spectral Compressive Imagingcited by 23
- 2022Residual Degradation Learning Unfolding Framework with Mixing Priors across Spectral and Spatial for Compressive Spectral Imagingcited by 22
- 2023Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstructioncited by 20
- 2023Progressive Content-aware Coded Hyperspectral Compressive Imagingcited by 6
- 2024ResVR: Joint Rescaling and Viewport Rendering of Omnidirectional Imagescited by 6
- 2023Dispersed Structured Light for Hyperspectral 3D Imagingcited by 4
- 2024RealOSR: Latent Guidance Boosts Diffusion-based Real-world Omnidirectional Image Super-Resolutionscited by 3
- 2023Unfolding Framework with Prior of Convolution-Transformer Mixture and Uncertainty Estimation for Video Snapshot Compressive Imagingcited by 2
- 2024Exploiting Frequency Correlation for Hyperspectral Image Reconstructioncited by 2
12 most cited of 23 All 23 (JSON)
- 2026Aperture-aware Dispersion 5-D Light-field Imaging Spectrometer6 Jul 2026
- 2026Deep LoRA-Unfolding Networks for Image Restoration21 Feb 2026
- 2025LRDUN: A Low-Rank Deep Unfolding Network for Efficient Spectral Compressive Imaging23 Nov 2025
- 2025SlowFast-SCI: Slow-Fast Deep Unfolding Learning for Spectral Compressive Imaging20 Sep 2025
- 2024RealOSR: Latent Guidance Boosts Diffusion-based Real-world Omnidirectional Image Super-Resolutions11 Dec 2024
- 2024Self-Supervised One-Step Diffusion Refinement for Snapshot Compressive Imaging11 Sep 2024
- 2024Inter and Intra Prior Learning-based Hyperspectral Image Reconstruction Using Snapshot SWIR Metasurface10 Jul 2024
- 2024Untrained Neural Nets for Snapshot Compressive Imaging: Theory and Algorithms6 Jun 2024
- 2024Exploiting Frequency Correlation for Hyperspectral Image Reconstruction2 Jun 2024
- 2024ResVR: Joint Rescaling and Viewport Rendering of Omnidirectional Images25 Apr 2024
- 2023BSS-Bench: Towards Reproducible and Effective Band Selection Search22 Dec 2023
- 2023Computational Spectral Imaging with Unified Encoding Model: A Comparative Study and Beyond20 Dec 2023
12 newest of 23 All 23 (JSON)