MP-HSIR: A Multi-Prompt Framework for Universal Hyperspectral Image Restoration
Not on the map. Why?
Abstract (arXiv)
Hyperspectral images (HSIs) often suffer from diverse and unknown degradations during imaging, leading to severe spectral and spatial distortions. Existing HSI restoration methods typically rely on specific degradation assumptions, limiting their effectiveness in complex scenarios. In this paper, we propose MP-HSIR, a novel multi-prompt framework that effectively integrates spectral, textual, and visual prompts to achieve universal HSI restoration across diverse degradation types and intensities. Specifically, we develop a prompt-guided spatial-spectral transformer, which incorporates spatial self-attention and a prompt-guided dual-branch spectral self-attention. Since degradations affect spectral features differently, we introduce spectral prompts in the local spectral branch to provide universal low-rank spectral patterns as prior knowledge for enhancing spectral reconstruction. Furthermore, the text-visual synergistic prompt fuses high-level semantic representations with fine-grained visual features to encode degradation information, thereby guiding the restoration process. Extensive experiments on 9 HSI restoration tasks, including all-in-one scenarios, generalization tests, and real-world cases, demonstrate that MP-HSIR not only consistently outperforms existing all-in-one methods but also surpasses state-of-the-art task-specific approaches across multiple tasks. The code and models are available at https://github.com/ZhehuiWu/MP-HSIR.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 37 of its 86 references that are in the map. First posted on arXiv 12 Mar 2025.
Builds on
37 of 86 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2022Simple Baselines for Image Restorationcited by 708
- 2021Pay Attention to MLPscited by 368
- 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
- 2022Prompt Distribution Learningcited by 235
- 2022Efficient Frequency Domain-based Transformers for High-Quality Image Deblurringcited by 165
- 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 140
25 more
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 140
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 92
- 2023MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazingcited by 81
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
- 2018Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Networkcited by 51
- 20203D Quasi-Recurrent Neural Network for Hyperspectral Image Denoisingcited by 44
- 2023Prompt-In-Prompt Learning for Universal Image Restorationcited by 43
- 2018Non-local Meets Global: An Integrated Paradigm for Hyperspectral Denoisingcited by 39
- 2024HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Modelscited by 39
- 2023Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoisingcited by 35
- 2021A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restorationcited by 34
- 2017Hyperspectral Unmixing: Ground Truth Labeling, Datasets, Benchmark Performances and Surveycited by 33
- 2023DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restorationcited by 33
- 2024Depth Information Assisted Collaborative Mutual Promotion Network for Single Image Dehazingcited by 32
- 2023HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Modelscited by 31
- 2022Multi-scale Attention Network for Single Image Super-Resolutioncited by 29
- 2023SPIRE: Semantic Prompt-Driven Image Restorationcited by 24
- 2023Efficient Multi-scale Network with Learnable Discrete Wavelet Transform for Blind Motion Deblurringcited by 24
- 2023ESSAformer: Efficient Transformer for Hyperspectral Image Super-resolutioncited by 23
- 2024LoFormer: Local Frequency Transformer for Image Deblurringcited by 20
- 2024Photo-Realistic Image Restoration in the Wild with Controlled Vision-Language Modelscited by 19
- 2023Hybrid Spectral Denoising Transformer with Guided Attentioncited by 16
- 2023SCANet: Self-Paced Semi-Curricular Attention Network for Non-Homogeneous Image Dehazingcited by 15
- 2024HAIR: Hypernetworks-based All-in-One Image Restorationcited by 12
- 2023Hyper-Restormer: A General Hyperspectral Image Restoration Transformer for Remote Sensing Imagingcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025Degradation-Aware Metric Prompting for Hyperspectral Image Restorationcited by 1
- 2026HSI-VAR: Rethinking Hyperspectral Restoration through Spatial-Spectral Visual Autoregressioncited by 1
- 2026Leveraging pretrained RGB denoisers for hyperspectral image restorationcited by 1
- 2026VP-Hype: A Hybrid Mamba-Transformer Framework with Visual-Textual Prompting for Hyperspectral Image Classificationcited by 0
- 2026Voronoi-guided Bilateral 2D Gaussian Splatting for Arbitrary-Scale Hyperspectral Image Super-Resolutioncited by 0
- 2026HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generationcited by 0
- 2026Leveraging pretrained RGB denoisers for hyperspectral image restoration23 May 2026
- 2026HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation13 May 2026
- 2026Voronoi-guided Bilateral 2D Gaussian Splatting for Arbitrary-Scale Hyperspectral Image Super-Resolution20 Apr 2026
- 2026VP-Hype: A Hybrid Mamba-Transformer Framework with Visual-Textual Prompting for Hyperspectral Image Classification1 Mar 2026
- 2026HSI-VAR: Rethinking Hyperspectral Restoration through Spatial-Spectral Visual Autoregression31 Jan 2026
- 2025Degradation-Aware Metric Prompting for Hyperspectral Image Restoration23 Dec 2025