# Self-Supervised Hyperspectral Inpainting with the Optimisation inspired Deep Neural Network Prior

arXiv: https://arxiv.org/abs/2306.07308 · HTML: https://mlsanity.com/paper/2306.07308/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 22 references that are in the map.
- First posted on arXiv 12 Jun 2023.

## Builds on (most cited first, 10 of 10)

- [Deep Image Prior](https://mlsanity.com/paper/1711.10925/) (2017)
- [DeepRED: Deep Image Prior Powered by RED](https://mlsanity.com/paper/1903.10176/) (2019)
- [Image Restoration using Total Variation Regularized Deep Image Prior](https://mlsanity.com/paper/1810.12864/) (2018)
- [Early Stopping for Deep Image Prior](https://mlsanity.com/paper/2112.06074/) (2021)
- [Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representations](https://mlsanity.com/paper/2103.06842/) (2021)
- [Deep Hyperspectral Prior: Denoising, Inpainting, Super-Resolution](https://mlsanity.com/paper/1902.00301/) (2019)
- [Self-supervised Neural Networks for Spectral Snapshot Compressive Imaging](https://mlsanity.com/paper/2108.12654/) (2021)
- [Deep Plug-and-Play Prior for Hyperspectral Image Restoration](https://mlsanity.com/paper/2209.08240/) (2022)
- [Solving Inverse Problems with Hybrid Deep Image Priors: the challenge of preventing overfitting](https://mlsanity.com/paper/2011.01748/) (2020)
- [Adaptive Deep PnP Algorithm for Video Snapshot Compressive Imaging](https://mlsanity.com/paper/2201.05483/) (2022)

## Built on by (most cited first, 1 of 1)

- [Self-supervised Deep Hyperspectral Inpainting with the Plug and Play and Deep Image Prior Models](https://mlsanity.com/paper/2501.08195/) (2025)

## Abstract (arXiv)

Hyperspectral Image (HSI)s cover hundreds or thousands of narrow spectral bands, conveying a wealth of spatial and spectral information. However, due to the instrumental errors and the atmospheric changes, the HSI obtained in practice are often contaminated by noise and dead pixels(lines), resulting in missing information that may severely compromise the subsequent applications. We introduce here a novel HSI missing pixel prediction algorithm, called Low Rank and Sparsity Constraint Plug-and-Play (LRS-PnP). It is shown that LRS-PnP is able to predict missing pixels and bands even when all spectral bands of the image are missing. The proposed LRS-PnP algorithm is further extended to a self-supervised model by combining the LRS-PnP with the Deep Image Prior (DIP), called LRS-PnP-DIP. In a series of experiments with real data, It is shown that the LRS-PnP-DIP either achieves state-of-the-art inpainting performance compared to other learning-based methods, or outperforms them.
