Plug-and-Play Algorithms for Large-scale Snapshot Compressive Imaging
Not on the map. Why?
Abstract (arXiv)
Snapshot compressive imaging (SCI) aims to capture the high-dimensional (usually 3D) images using a 2D sensor (detector) in a single snapshot. Though enjoying the advantages of low-bandwidth, low-power and low-cost, applying SCI to large-scale problems (HD or UHD videos) in our daily life is still challenging. The bottleneck lies in the reconstruction algorithms; they are either too slow (iterative optimization algorithms) or not flexible to the encoding process (deep learning based end-to-end networks). In this paper, we develop fast and flexible algorithms for SCI based on the plug-and-play (PnP) framework. In addition to the widely used PnP-ADMM method, we further propose the PnP-GAP (generalized alternating projection) algorithm with a lower computational workload and prove the convergence of PnP-GAP under the SCI hardware constraints. By employing deep denoising priors, we first time show that PnP can recover a UHD color video (3840× 1644× 48 with PNSR above 30dB) from a snapshot 2D measurement. Extensive results on both simulation and real datasets verify the superiority of our proposed algorithm. The code is available at https://github.com/liuyang12/PnP-SCI.
Key facts. Cited by 78 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 18; 2023: 14; 2024: 13; 2025: 8; 2026: 6.
78 papers.
Sort:
By area:
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
- 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 79
- 2022Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstructioncited by 67
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
- 2021Deep Gaussian Scale Mixture Prior for Spectral Compressive Imagingcited by 58
- 2021Plug-and-Play Algorithms for Video Snapshot Compressive Imagingcited by 42
- 2021Self-supervised Neural Networks for Spectral Snapshot Compressive Imagingcited by 35
- 2021Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imagingcited by 31
- 2021Memory-Efficient Network for Large-scale Video Compressive Sensingcited by 30
- 2021MetaSCI: Scalable and Adaptive Reconstruction for Video Compressive Sensingcited by 29
38 more
- 2021HerosNet: Hyperspectral Explicable Reconstruction and Optimal Sampling Deep Network for Snapshot Compressive Imagingcited by 26
- 2022Residual Degradation Learning Unfolding Framework with Mixing Priors across Spectral and Spatial for Compressive Spectral Imagingcited by 22
- 2022Spatial-Temporal Transformer for Video Snapshot Compressive Imagingcited by 21
- 2023Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstructioncited by 20
- 2021Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolutioncited by 19
- 2023EfficientSCI: Densely Connected Network with Space-time Factorization for Large-scale Video Snapshot Compressive Imagingcited by 18
- 2021CSformer: Bridging Convolution and Transformer for Compressive Sensingcited by 14
- 2023Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysiscited by 10
- 2024Deep Optics for Video Snapshot Compressive Imagingcited by 8
- 2021Computational Imaging and Artificial Intelligence: The Next Revolution of Mobile Visioncited by 7
- 2024Unrolled Decomposed Unpaired Learning for Controllable Low-Light Video Enhancementcited by 7
- 2024MambaSCI: Efficient Mamba-UNet for Quad-Bayer Patterned Video Snapshot Compressive Imagingcited by 7
- 2023Progressive Content-aware Coded Hyperspectral Compressive Imagingcited by 6
- 2023DiffSCI: Zero-Shot Snapshot Compressive Imaging via Iterative Spectral Diffusion Modelcited by 6
- 2022Deep Equilibrium Models for Video Snapshot Compressive Imagingcited by 5
- 2022JR2net: A Joint Non-Linear Representation and Recovery Network for Compressive Spectral Imagingcited by 5
- 2022Optimization-Derived Learning with Essential Convergence Analysis of Training and Hyper-trainingcited by 5
- 2023Convergent plug-and-play with proximal denoiser and unconstrained regularization parametercited by 5
- 2021Modeling Mask Uncertainty in Hyperspectral Image Reconstructioncited by 4
- 2022Spectral Compressive Imaging Reconstruction Using Convolution and Contextual Transformercited by 4
- 2022Acquiring a Dynamic Light Field through a Single-Shot Coded Imagecited by 4
- 2022Two-Stage is Enough: A Concise Deep Unfolding Reconstruction Network for Flexible Video Compressive Sensingcited by 3
- 2022Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platformscited by 3
- 2023Single-Shot Plug-and-Play Methods for Inverse Problemscited by 3
- 2024SCINeRF: Neural Radiance Fields from a Snapshot Compressive Imagecited by 3
- 202110-mega pixel snapshot compressive imaging with a hybrid coded aperturecited by 2
- 2021Revisit Dictionary Learning for Video Compressive Sensing under the Plug-and-Play Frameworkcited by 2
- 2022REPNP: Plug-and-Play with Deep Reinforcement Learning Prior for Robust Image Restorationcited by 2
- 2023RDFNet: Regional Dynamic FISTA-Net for Spectral Snapshot Compressive Imagingcited by 2
- 2023Unfolding Framework with Prior of Convolution-Transformer Mixture and Uncertainty Estimation for Video Snapshot Compressive Imagingcited by 2
- 2024SnapCap: Efficient Snapshot Compressive Video Captioningcited by 2
- 2024Event-Enhanced Snapshot Compressive Videography at 10K FPScited by 2
- 2024Dual Hyperspectral Mamba for Efficient Spectral Compressive Imagingcited by 2
- 2024You KAN Do It in a Single Shot: Plug-and-Play Methods with Single-Instance Priorscited by 2
- 2021Reinforcement Learning for Adaptive Video Compressive Sensingcited by 1
- 2021A Simple and Efficient Reconstruction Backbone for Snapshot Compressive Imagingcited by 1
- 2021Dual-view Snapshot Compressive Imaging via Optical Flow Aided Recurrent Neural Networkcited by 1
- 2022Motion-aware Dynamic Graph Neural Network for Video Compressive Sensingcited by 1
50 most cited of 78 All 78 (JSON)
- 2026GS2CI: Robust Gaussian Splatting For Snapshot Compressive Imaging via Large Vision Model Priors13 Aug 2026
- 2026RayFormer: Modeling Inter- and Intra-Ray Similarity for NeRF-Based Video Snapshot Compressive Imaging30 Apr 2026
- 2026FUN: A Focal U-Net Combining Reconstruction and Object Detection for Snapshot Spectral Imaging30 Apr 2026
- 2026RobustSCI: Beyond Reconstruction to Restoration for Snapshot Compressive Imaging under Real-World Degradations8 Mar 2026
- 2026Exploring Spatiotemporal Feature Propagation for Video-Level Compressive Spectral Reconstruction: Dataset, Model and Benchmark28 Feb 2026
- 2026Efficient Hyperspectral Image Reconstruction Using Lightweight Separate Spectral Transformers3 Jan 2026
- 20253One2: One-step Regression Plus One-step Diffusion for One-hot Modulation in Dual-path Video Snapshot Compressive Imaging19 Dec 2025
- 2025LRDUN: A Low-Rank Deep Unfolding Network for Efficient Spectral Compressive Imaging23 Nov 2025
- 2025Plug-and-play Diffusion Models for Image Compressive Sensing with Data Consistency Projection11 Sep 2025
- 2025Sparse Transformer for Ultra-sparse Sampled Video Compressive Sensing10 Sep 2025
- 2025User Manual for Model-based Imaging Inverse Problem1 Sep 2025
- 2025Spectrum from Defocus: Fast Spectral Imaging with Chromatic Focal Stack26 Mar 2025
38 more
- 2025Using Powerful Prior Knowledge of Diffusion Model in Deep Unfolding Networks for Image Compressive Sensing11 Mar 2025
- 2025Vision without Images: End-to-End Computer Vision from Single Compressive Measurements25 Jan 2025
- 2024Ultra-Low Complexity On-Orbit Compression for Remote Sensing Imagery via Block Modulated Imaging24 Dec 2024
- 2024You KAN Do It in a Single Shot: Plug-and-Play Methods with Single-Instance Priors9 Dec 2024
- 2024SCIGS: 3D Gaussians Splatting from a Snapshot Compressive Image19 Nov 2024
- 2024MambaSCI: Efficient Mamba-UNet for Quad-Bayer Patterned Video Snapshot Compressive Imaging18 Oct 2024
- 2024Unrolled Decomposed Unpaired Learning for Controllable Low-Light Video Enhancement22 Aug 2024
- 2024Towards Real-time Video Compressive Sensing on Mobile Devices14 Aug 2024
- 2024Inter and Intra Prior Learning-based Hyperspectral Image Reconstruction Using Snapshot SWIR Metasurface10 Jul 2024
- 2024Untrained Neural Nets for Snapshot Compressive Imaging: Theory and Algorithms6 Jun 2024
- 2024Dual Hyperspectral Mamba for Efficient Spectral Compressive Imaging1 Jun 2024
- 2024Event-Enhanced Snapshot Compressive Videography at 10K FPS11 Apr 2024
- 2024Deep Optics for Video Snapshot Compressive Imaging8 Apr 2024
- 2024SCINeRF: Neural Radiance Fields from a Snapshot Compressive Image29 Mar 2024
- 2024SnapCap: Efficient Snapshot Compressive Video Captioning10 Jan 2024
- 2023BSS-Bench: Towards Reproducible and Effective Band Selection Search22 Dec 2023
- 2023Learning Exhaustive Correlation for Spectral Super-Resolution: Where Spatial-Spectral Attention Meets Linear Dependence20 Dec 2023
- 2023Single-Shot Plug-and-Play Methods for Inverse Problems22 Nov 2023
- 2023DiffSCI: Zero-Shot Snapshot Compressive Imaging via Iterative Spectral Diffusion Model19 Nov 2023
- 2023Convergent plug-and-play with proximal denoiser and unconstrained regularization parameter2 Nov 2023
- 2023Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysis29 Sep 2023
- 2023Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction21 Aug 2023
- 2023DMDC: Dynamic-mask-based dual camera design for snapshot Hyperspectral Imaging3 Aug 2023
- 2023Sampling-Priors-Augmented Deep Unfolding Network for Robust Video Compressive Sensing14 Jul 2023
- 2023Unfolding Framework with Prior of Convolution-Transformer Mixture and Uncertainty Estimation for Video Snapshot Compressive Imaging20 Jun 2023
- 2023EfficientSCI: Densely Connected Network with Space-time Factorization for Large-scale Video Snapshot Compressive Imaging17 May 2023
- 2023Progressive Content-aware Coded Hyperspectral Compressive Imaging17 Mar 2023
- 2023RDFNet: Regional Dynamic FISTA-Net for Spectral Snapshot Compressive Imaging6 Feb 2023
- 2023Large-scale Global Low-rank Optimization for Computational Compressed Imaging8 Jan 2023
- 2022Residual Degradation Learning Unfolding Framework with Mixing Priors across Spectral and Spatial for Compressive Spectral Imaging13 Nov 2022
- 2022Mixture-Net: Low-Rank Deep Image Prior Inspired by Mixture Models for Spectral Image Recovery5 Nov 2022
- 2022Spatial-Temporal Transformer for Video Snapshot Compressive Imaging4 Sep 2022
- 2022REPNP: Plug-and-Play with Deep Reinforcement Learning Prior for Robust Image Restoration25 Jul 2022
- 2022Optimization-Derived Learning with Essential Convergence Analysis of Training and Hyper-training16 Jun 2022
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging20 May 2022
- 2022JR2net: A Joint Non-Linear Representation and Recovery Network for Compressive Spectral Imaging16 May 2022
- 2022Block Modulating Video Compression: An Ultra Low Complexity Image Compression Encoder for Resource Limited Platforms7 May 2022
- 2022Deep Generalized Unfolding Networks for Image Restoration28 Apr 2022
50 newest of 78 All 78 (JSON)
- 2023DiffSCI: Zero-Shot Snapshot Compressive Imaging via Iterative Spectral Diffusion Modelcited by 6
- 2025Using Powerful Prior Knowledge of Diffusion Model in Deep Unfolding Networks for Image Compressive Sensingcited by 1
- 2025Plug-and-play Diffusion Models for Image Compressive Sensing with Data Consistency Projectioncited by 0
- 2025Plug-and-play Diffusion Models for Image Compressive Sensing with Data Consistency Projection11 Sep 2025
- 2025Using Powerful Prior Knowledge of Diffusion Model in Deep Unfolding Networks for Image Compressive Sensing11 Mar 2025
- 2023DiffSCI: Zero-Shot Snapshot Compressive Imaging via Iterative Spectral Diffusion Model19 Nov 2023
- 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2021Gradient Step Denoiser for convergent Plug-and-Playcited by 107
- 2022Proximal Denoiser for Convergent Plug-and-Play Optimization with Nonconvex Regularizationcited by 79
- 2022Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstructioncited by 67
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
- 2021Deep Gaussian Scale Mixture Prior for Spectral Compressive Imagingcited by 58
- 2021Plug-and-Play Algorithms for Video Snapshot Compressive Imagingcited by 42
- 2021Self-supervised Neural Networks for Spectral Snapshot Compressive Imagingcited by 35
- 2021Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imagingcited by 31
- 2021Memory-Efficient Network for Large-scale Video Compressive Sensingcited by 30
- 2021MetaSCI: Scalable and Adaptive Reconstruction for Video Compressive Sensingcited by 29
12 most cited of 73 All 73 (JSON)
- 2026GS2CI: Robust Gaussian Splatting For Snapshot Compressive Imaging via Large Vision Model Priors13 Aug 2026
- 2026RayFormer: Modeling Inter- and Intra-Ray Similarity for NeRF-Based Video Snapshot Compressive Imaging30 Apr 2026
- 2026FUN: A Focal U-Net Combining Reconstruction and Object Detection for Snapshot Spectral Imaging30 Apr 2026
- 2026RobustSCI: Beyond Reconstruction to Restoration for Snapshot Compressive Imaging under Real-World Degradations8 Mar 2026
- 2026Exploring Spatiotemporal Feature Propagation for Video-Level Compressive Spectral Reconstruction: Dataset, Model and Benchmark28 Feb 2026
- 2026Efficient Hyperspectral Image Reconstruction Using Lightweight Separate Spectral Transformers3 Jan 2026
- 20253One2: One-step Regression Plus One-step Diffusion for One-hot Modulation in Dual-path Video Snapshot Compressive Imaging19 Dec 2025
- 2025LRDUN: A Low-Rank Deep Unfolding Network for Efficient Spectral Compressive Imaging23 Nov 2025
- 2025Sparse Transformer for Ultra-sparse Sampled Video Compressive Sensing10 Sep 2025
- 2025User Manual for Model-based Imaging Inverse Problem1 Sep 2025
- 2025Spectrum from Defocus: Fast Spectral Imaging with Chromatic Focal Stack26 Mar 2025
- 2025Vision without Images: End-to-End Computer Vision from Single Compressive Measurements25 Jan 2025
12 newest of 73 All 73 (JSON)