# Deep Plug-and-Play Prior for Hyperspectral Image Restoration

arXiv: https://arxiv.org/abs/2209.08240 · HTML: https://mlsanity.com/paper/2209.08240/

## Key facts

- Cited by 22 papers in the map (data through 14 Oct 2026).
- Builds on 23 of its 67 references that are in the map.
- First posted on arXiv 17 Sep 2022.

## Builds on (most cited first, 23 of 23)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising](https://mlsanity.com/paper/1608.03981/) (2016)
- [FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising](https://mlsanity.com/paper/1710.04026/) (2017)
- [Plug-and-Play Image Restoration with Deep Denoiser Prior](https://mlsanity.com/paper/2008.13751/) (2020)
- [Learning Deep CNN Denoiser Prior for Image Restoration](https://mlsanity.com/paper/1704.03264/) (2017)
- [Plug-and-Play ADMM for Image Restoration: Fixed Point Convergence and Applications](https://mlsanity.com/paper/1605.01710/) (2016)
- [Deep Plug-and-Play Super-Resolution for Arbitrary Blur Kernels](https://mlsanity.com/paper/1903.12529/) (2019)
- [Rank Minimization for Snapshot Compressive Imaging](https://mlsanity.com/paper/1807.07837/) (2018)
- [Hyperspectral Image Restoration via Total Variation Regularized Low-rank Tensor Decomposition](https://mlsanity.com/paper/1707.02477/) (2017)
- [Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Network](https://mlsanity.com/paper/1806.00183/) (2018)
- [Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery](https://mlsanity.com/paper/2005.08752/) (2020)
- [3D Quasi-Recurrent Neural Network for Hyperspectral Image Denoising](https://mlsanity.com/paper/2003.04547/) (2020)
- [Non-local Meets Global: An Iterative Paradigm for Hyperspectral Image Restoration](https://mlsanity.com/paper/2010.12921/) (2020)
- [Non-local Meets Global: An Integrated Paradigm for Hyperspectral Denoising](https://mlsanity.com/paper/1812.04243/) (2018)
- [Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representations](https://mlsanity.com/paper/2103.06842/) (2021)
- [Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problems](https://mlsanity.com/paper/2002.09611/) (2020)
- [Block Coordinate Regularization by Denoising](https://mlsanity.com/paper/1905.05113/) (2019)
- [Weighted Low-rank Tensor Recovery for Hyperspectral Image Restoration](https://mlsanity.com/paper/1709.00192/) (2017)
- [Denoising Hyperspectral Image with Non-i.i.d. Noise Structure](https://mlsanity.com/paper/1702.00098/) (2017)
- [TFPnP: Tuning-free Plug-and-Play Proximal Algorithm with Applications to Inverse Imaging Problems](https://mlsanity.com/paper/2012.05703/) (2020)

## Built on by (most cited first, 22 of 22)

- [Pixel Adaptive Deep Unfolding Transformer for Hyperspectral Image Reconstruction](https://mlsanity.com/paper/2308.10820/) (2023)
- [Hybrid Spectral Denoising Transformer with Guided Attention](https://mlsanity.com/paper/2303.09040/) (2023)
- [Mixed Attention Network for Hyperspectral Image Denoising](https://mlsanity.com/paper/2301.11525/) (2023)
- [HSIDMamba: Exploring Bidirectional State-Space Models for Hyperspectral Denoising](https://mlsanity.com/paper/2404.09697/) (2024)
- [PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptation](https://mlsanity.com/paper/2411.15922/) (2024)
- [Degradation-Noise-Aware Deep Unfolding Transformer for Hyperspectral Image Denoising](https://mlsanity.com/paper/2305.04047/) (2023)
- [Unsupervised Spectral Demosaicing with Lightweight Spectral Attention Networks](https://mlsanity.com/paper/2307.01990/) (2023)
- [AE-RED: A Hyperspectral Unmixing Framework Powered by Deep Autoencoder and Regularization by Denoising](https://mlsanity.com/paper/2307.00269/) (2023)
- [Dual Hyperspectral Mamba for Efficient Spectral Compressive Imaging](https://mlsanity.com/paper/2406.00449/) (2024)
- [MCDIP-ADMM: Overcoming Overfitting in DIP-based CT reconstruction](https://mlsanity.com/paper/2304.03895/) (2023)
- [Self-Supervised Hyperspectral Inpainting with the Optimisation inspired Deep Neural Network Prior](https://mlsanity.com/paper/2306.07308/) (2023)
- [Self-supervised Deep Hyperspectral Inpainting with the Sparsity and Low-Rank Considerations](https://mlsanity.com/paper/2306.08128/) (2023)
- [Hyperspectral Anomaly Detection with Self-Supervised Anomaly Prior](https://mlsanity.com/paper/2404.13342/) (2024)
- [Deep priors for satellite image restoration with accurate uncertainties](https://mlsanity.com/paper/2412.04130/) (2024)
- [Self-supervised Deep Hyperspectral Inpainting with the Plug and Play and Deep Image Prior Models](https://mlsanity.com/paper/2501.08195/) (2025)
- [SHARE: A Fully Unsupervised Framework for Single Hyperspectral Image Restoration](https://mlsanity.com/paper/2601.13987/) (2026)
- [Leveraging pretrained RGB denoisers for hyperspectral image restoration](https://mlsanity.com/paper/2605.24769/) (2026)
- [Improved Quasi-Recurrent Neural Network for Hyperspectral Image Denoising](https://mlsanity.com/paper/2211.14811/) (2022)
- [Guided Deep Generative Model-based Spatial Regularization for Multiband Imaging Inverse Problems](https://mlsanity.com/paper/2306.17197/) (2023)
- [A TRPCA-Inspired Deep Unfolding Network for Hyperspectral Image Denoising via Thresholded t-SVD and Top-K Sparse Transformer](https://mlsanity.com/paper/2506.02364/) (2025)
- [Hyperspectral Image Recovery Constrained by Multi-Granularity Non-Local Self-Similarity Priors](https://mlsanity.com/paper/2508.01435/) (2025)
- [Perspective-Equivariant Fine-tuning for Multispectral Demosaicing without Ground Truth](https://mlsanity.com/paper/2603.01332/) (2026)

## Abstract (arXiv)

Deep-learning-based hyperspectral image (HSI) restoration methods have gained great popularity for their remarkable performance but often demand expensive network retraining whenever the specifics of task changes. In this paper, we propose to restore HSIs in a unified approach with an effective plug-and-play method, which can jointly retain the flexibility of optimization-based methods and utilize the powerful representation capability of deep neural networks. Specifically, we first develop a new deep HSI denoiser leveraging gated recurrent convolution units, short- and long-term skip connections, and an augmented noise level map to better exploit the abundant spatio-spectral information within HSIs. It, therefore, leads to the state-of-the-art performance on HSI denoising under both Gaussian and complex noise settings. Then, the proposed denoiser is inserted into the plug-and-play framework as a powerful implicit HSI prior to tackle various HSI restoration tasks. Through extensive experiments on HSI super-resolution, compressed sensing, and inpainting, we demonstrate that our approach often achieves superior performance, which is competitive with or even better than the state-of-the-art on each task, via a single model without any task-specific training.