# Hipandas: Hyperspectral Image Joint Denoising and Super-Resolution by Image Fusion with the Panchromatic Image

arXiv: https://arxiv.org/abs/2412.04201 · HTML: https://mlsanity.com/paper/2412.04201/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 61 references that are in the map.
- First posted on arXiv 5 Dec 2024.

## Builds on (most cited first, 22 of 22)

- [SwinIR: Image Restoration Using Swin Transformer](https://mlsanity.com/paper/2108.10257/) (2021)
- [CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion](https://mlsanity.com/paper/2211.14461/) (2022)
- [Overview frequency principle/spectral bias in deep learning](https://mlsanity.com/paper/2201.07395/) (2022)
- [Hyperspectral Image Restoration via Total Variation Regularized Low-rank Tensor Decomposition](https://mlsanity.com/paper/1707.02477/) (2017)
- [EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution](https://mlsanity.com/paper/2310.19288/) (2023)
- [Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Network](https://mlsanity.com/paper/1806.00183/) (2018)
- [Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagery](https://mlsanity.com/paper/2005.08752/) (2020)
- [3D Quasi-Recurrent Neural Network for Hyperspectral Image Denoising](https://mlsanity.com/paper/2003.04547/) (2020)
- [Deep Gradient Projection Networks for Pan-sharpening](https://mlsanity.com/paper/2103.04584/) (2021)
- [Non-local Meets Global: An Iterative Paradigm for Hyperspectral Image Restoration](https://mlsanity.com/paper/2010.12921/) (2020)
- [Guaranteed Tensor Recovery Fused Low-rankness and Smoothness](https://mlsanity.com/paper/2302.02155/) (2023)
- [HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models](https://mlsanity.com/paper/2402.15865/) (2024)
- [Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoising](https://mlsanity.com/paper/2304.00844/) (2023)
- [Spatial-Spectral Transformer for Hyperspectral Image Denoising](https://mlsanity.com/paper/2211.14090/) (2022)
- [DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restoration](https://mlsanity.com/paper/2303.06682/) (2023)
- [HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models](https://mlsanity.com/paper/2306.12085/) (2023)
- [Unsupervised Hyperspectral Pansharpening via Low-rank Diffusion Model](https://mlsanity.com/paper/2305.10925/) (2023)
- [Exact Decomposition of Joint Low Rankness and Local Smoothness Plus Sparse Matrices](https://mlsanity.com/paper/2201.12592/) (2022)
- [Spectral Response Function Guided Deep Optimization-driven Network for Spectral Super-resolution](https://mlsanity.com/paper/2011.09701/) (2020)
- [Enhancing Hyperspectral Images via Diffusion Model and Group-Autoencoder Super-resolution Network](https://mlsanity.com/paper/2402.17285/) (2024)
- [Band-wise Hyperspectral Image Pansharpening using CNN Model Propagation](https://mlsanity.com/paper/2311.06510/) (2023)
- [Pan-denoising: Guided Hyperspectral Image Denoising via Weighted Represent Coefficient Total Variation](https://mlsanity.com/paper/2407.06064/) (2024)

## Built on by (most cited first, 4 of 4)

- [Universal Pansharpening Model](https://mlsanity.com/paper/2603.03831/) (2026)
- [USP-Mamba: Unmixing-Derived Spectral and Structural Prompting for Hyperspectral Image Super-Resolution](https://mlsanity.com/paper/2608.02401/) (2026)
- [Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening](https://mlsanity.com/paper/2608.11748/) (2026)
- [S3-PnP: Plug-and-Play Denoising for Scientific Imaging with Self-Supervised Score Priors](https://mlsanity.com/paper/2610.18458/) (2026)

## Abstract (arXiv)

Hyperspectral images (HSIs) are frequently noisy and of low resolution due to the constraints of imaging devices. Recently launched satellites can concurrently acquire HSIs and panchromatic (PAN) images, enabling the restoration of HSIs to generate clean and high-resolution imagery through fusing PAN images for denoising and super-resolution. However, previous studies treated these two tasks as independent processes, resulting in accumulated errors. This paper introduces Hyperspectral Image Joint Pandenoising and Pansharpening (Hipandas), a novel learning paradigm that reconstructs HRHS images from noisy low-resolution HSIs (LRHS) and high-resolution PAN images. The proposed zero-shot Hipandas framework consists of a guided denoising network, a guided super-resolution network, and a PAN reconstruction network, utilizing an HSI low-rank prior and a newly introduced detail-oriented low-rank prior. The interconnection of these networks complicates the training process, necessitating a two-stage training strategy to ensure effective training. Experimental results on both simulated and real-world datasets indicate that the proposed method surpasses state-of-the-art algorithms, yielding more accurate and visually pleasing HRHS images.
