mlsanityData to 14 Oct 2026

MP-HSIR: A Multi-Prompt Framework for Universal Hyperspectral Image Restoration

arXiv 2503.09131 ↗First posted 12 Mar 2025cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Hyperspectral images (HSIs) often suffer from diverse and unknown degradations during imaging, leading to severe spectral and spatial distortions. Existing HSI restoration methods typically rely on specific degradation assumptions, limiting their effectiveness in complex scenarios. In this paper, we propose MP-HSIR, a novel multi-prompt framework that effectively integrates spectral, textual, and visual prompts to achieve universal HSI restoration across diverse degradation types and intensities. Specifically, we develop a prompt-guided spatial-spectral transformer, which incorporates spatial self-attention and a prompt-guided dual-branch spectral self-attention. Since degradations affect spectral features differently, we introduce spectral prompts in the local spectral branch to provide universal low-rank spectral patterns as prior knowledge for enhancing spectral reconstruction. Furthermore, the text-visual synergistic prompt fuses high-level semantic representations with fine-grained visual features to encode degradation information, thereby guiding the restoration process. Extensive experiments on 9 HSI restoration tasks, including all-in-one scenarios, generalization tests, and real-world cases, demonstrate that MP-HSIR not only consistently outperforms existing all-in-one methods but also surpasses state-of-the-art task-specific approaches across multiple tasks. The code and models are available at https://github.com/ZhehuiWu/MP-HSIR.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 37 of its 86 references that are in the map. First posted on arXiv 12 Mar 2025.

Builds on

37 of 86 references.

References · 37

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  4. 2016Identity Mappings in Deep Residual Networkscited by 1,965
  5. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  6. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  7. 2022Simple Baselines for Image Restorationcited by 708
  8. 2021Pay Attention to MLPscited by 368
  9. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 352
  10. 2022Prompt Distribution Learningcited by 235
  11. 2022Efficient Frequency Domain-based Transformers for High-Quality Image Deblurringcited by 165
  12. 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 140
25 more
  1. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 140
  2. 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 92
  3. 2023MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazingcited by 81
  4. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
  5. 2018Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Networkcited by 51
  6. 20203D Quasi-Recurrent Neural Network for Hyperspectral Image Denoisingcited by 44
  7. 2023Prompt-In-Prompt Learning for Universal Image Restorationcited by 43
  8. 2018Non-local Meets Global: An Integrated Paradigm for Hyperspectral Denoisingcited by 39
  9. 2024HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Modelscited by 39
  10. 2023Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoisingcited by 35
  11. 2021A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restorationcited by 34
  12. 2017Hyperspectral Unmixing: Ground Truth Labeling, Datasets, Benchmark Performances and Surveycited by 33
  13. 2023DDS2M: Self-Supervised Denoising Diffusion Spatio-Spectral Model for Hyperspectral Image Restorationcited by 33
  14. 2024Depth Information Assisted Collaborative Mutual Promotion Network for Single Image Dehazingcited by 32
  15. 2023HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Modelscited by 31
  16. 2022Multi-scale Attention Network for Single Image Super-Resolutioncited by 29
  17. 2023SPIRE: Semantic Prompt-Driven Image Restorationcited by 24
  18. 2023Efficient Multi-scale Network with Learnable Discrete Wavelet Transform for Blind Motion Deblurringcited by 24
  19. 2023ESSAformer: Efficient Transformer for Hyperspectral Image Super-resolutioncited by 23
  20. 2024LoFormer: Local Frequency Transformer for Image Deblurringcited by 20
  21. 2024Photo-Realistic Image Restoration in the Wild with Controlled Vision-Language Modelscited by 19
  22. 2023Hybrid Spectral Denoising Transformer with Guided Attentioncited by 16
  23. 2023SCANet: Self-Paced Semi-Curricular Attention Network for Non-Homogeneous Image Dehazingcited by 15
  24. 2024HAIR: Hypernetworks-based All-in-One Image Restorationcited by 12
  25. 2023Hyper-Restormer: A General Hyperspectral Image Restoration Transformer for Remote Sensing Imagingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.