PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptation
Not on the map. Why?
Abstract (arXiv)
Recent advances in All-in-One (AiO) RGB image restoration have demonstrated the effectiveness of prompt learning in handling multiple degradations within a single model. However, extending these approaches to hyperspectral image (HSI) restoration is challenging due to the domain gap between RGB and HSI features, information loss in visual prompts under severe composite degradations, and difficulties in capturing HSI-specific degradation patterns via text prompts. In this paper, we propose PromptHSI, the first universal AiO HSI restoration framework that addresses these challenges. By incorporating frequency-aware feature modulation, which utilizes frequency analysis to narrow down the restoration search space and employing vision-language model (VLM)-guided prompt learning, our approach decomposes text prompts into intensity and bias controllers that effectively guide the restoration process while mitigating domain discrepancies. Extensive experiments demonstrate that our unified architecture excels at both fine-grained recovery and global information restoration across diverse degradation scenarios, highlighting its significant potential for practical remote sensing applications. The source code is available at https://github.com/chingheng0808/PromptHSI.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 41 of its 81 references that are in the map. First posted on arXiv 24 Nov 2024.
Builds on
41 of 81 references.
References · 41
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
- 2019Deep Learning for Hyperspectral Image Classification: An Overviewcited by 121
- 2021Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstructioncited by 110
29 more
- 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 108
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
- 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 83
- 2019A General Decoupled Learning Framework for Parameterized Image Operatorscited by 72
- 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstructioncited by 72
- 2018An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixingcited by 65
- 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
- 2018Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Networkcited by 51
- 2020Learning Spatial-Spectral Prior for Super-Resolution of Hyperspectral Imagerycited by 47
- 2022Low-Rank Tensor Function Representation for Multi-Dimensional Data Recoverycited by 45
- 2024DRCT: Saving Image Super-resolution away from Information Bottleneckcited by 40
- 2018Non-local Meets Global: An Integrated Paradigm for Hyperspectral Denoisingcited by 39
- 2021Fast Hyperspectral Image Denoising and Inpainting Based on Low-Rank and Sparse Representationscited by 39
- 2019Deep Hyperspectral Prior: Denoising, Inpainting, Super-Resolutioncited by 36
- 2023Improving Image Restoration through Removing Degradations in Textual Representationscited by 36
- 2023Spectral Enhanced Rectangle Transformer for Hyperspectral Image Denoisingcited by 35
- 2021A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restorationcited by 34
- 2022Spatial-Spectral Transformer for Hyperspectral Image Denoisingcited by 34
- 2018Missing Data Reconstruction in Remote Sensing image with a Unified Spatial-Temporal-Spectral Deep Convolutional Neural Networkcited by 26
- 2022A Closer Look at Blind Super-Resolution: Degradation Models, Baselines, and Performance Upper Boundscited by 22
- 2022Deep Plug-and-Play Prior for Hyperspectral Image Restorationcited by 22
- 2023Hybrid Spectral Denoising Transformer with Guided Attentioncited by 16
- 2022Fast Noise Removal in Hyperspectral Images via Representative Coefficient Total Variationcited by 13
- 2024HAIR: Hypernetworks-based All-in-One Image Restorationcited by 12
- 2023Hyperspectral Image Super-Resolution via Dual-domain Network Based on Hybrid Convolutioncited by 5
- 2024Real-Time Compressed Sensing for Joint Hyperspectral Image Transmission and Restoration for CubeSatcited by 3
- 2023Hyper-Restormer: A General Hyperspectral Image Restoration Transformer for Remote Sensing Imagingcited by 2
- 2024CSAKD: Knowledge Distillation with Cross Self-Attention for Hyperspectral and Multispectral Image Fusioncited by 1
- 2024Self-supervised Fusarium Head Blight Detection with Hyperspectral Image and Feature Miningcited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 3.
6 papers.
- 2025DenseSR: Image Shadow Removal as Dense Predictioncited by 5
- 2025Taming Domain Shift in Multi-source CT-Scan Classification via Input-Space Standardizationcited by 2
- 2025Degradation-Aware Metric Prompting for Hyperspectral Image Restorationcited by 1
- 2026HSI-VAR: Rethinking Hyperspectral Restoration through Spatial-Spectral Visual Autoregressioncited by 1
- 2026VP-Hype: A Hybrid Mamba-Transformer Framework with Visual-Textual Prompting for Hyperspectral Image Classificationcited by 0
- 2026HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generationcited by 0
- 2026HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation13 May 2026
- 2026VP-Hype: A Hybrid Mamba-Transformer Framework with Visual-Textual Prompting for Hyperspectral Image Classification1 Mar 2026
- 2026HSI-VAR: Rethinking Hyperspectral Restoration through Spatial-Spectral Visual Autoregression31 Jan 2026
- 2025Degradation-Aware Metric Prompting for Hyperspectral Image Restoration23 Dec 2025
- 2025Taming Domain Shift in Multi-source CT-Scan Classification via Input-Space Standardization26 Jul 2025
- 2025DenseSR: Image Shadow Removal as Dense Prediction22 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2024HIR-Diff: Unsupervised Hyperspectral Image Restoration Via Improved Diffusion Models
- 2026A Unified Foundation Model for All-in-One Multi-Modal Remote Sensing Image Restoration and Fusion with Language Prompting
- 2023HSR-Diff:Hyperspectral Image Super-Resolution via Conditional Diffusion Models
- 2026USP-Mamba: Unmixing-Derived Spectral and Structural Prompting for Hyperspectral Image Super-Resolution
- 2025FrogDogNet: Fourier frequency Retained visual prompt Output Guidance for Domain Generalization of CLIP in Remote Sensing
- 2024Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration
- 2025Prompt to Restore, Restore to Prompt: Cyclic Prompting for Universal Adverse Weather Removal
- 2025HSRMamba: Contextual Spatial-Spectral State Space Model for Single Image Hyperspectral Super-Resolution