mlsanityData to 7 Oct 2026

Degradation-Aware Prompt Learning with Cross-Modal Compensation for Adverse Weather Removal

arXiv 2608.06939 ↗First posted 7 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Adverse weather causes diverse and complex image degradations, severely compromising the reliability of computer vision systems. Existing all-in-one restoration models attempt to address multiple degradation types within a unified framework, but often lack explicit spatial and semantic modeling of degradation characteristics, limiting their adaptability to diverse weather conditions. To address this limitation, we propose a Degradation-Aware Cross-Modal Prompt Compensation Network (DCMPC-Net) that leverages cross-modal degradation cues from a pretrained vision-language model to condition restoration features within a unified backbone. Specifically, our DCMPC-Net mainly consists of the Cross-Modal Prompt Generator (CMPG), Prompt-Guided Attention Alignment Module (PGAAM), and Dual Feature Compensation Module (DFCM). The CMPG integrates textual embeddings with visual features to produce degradation-aware prompts that encode degradation-related semantic and contextual cues. These prompts are injected into the decoder via a PGAAM, which adaptively aligns semantic information with degraded regions to facilitate context-aware restoration. To further enhance structural fidelity, DFCM is introduced that disentangles degradation artifacts from scene structures, thereby improving the reconstruction of fine textures and detailed content. By integrating cross-modal semantic guidance with spatial alignment and structural enhancement, DCMPC-Net achieves robust and perceptually consistent restoration across diverse weather conditions. Extensive experiments show that DCMPC-Net outperforms state-of-the-art methods in both task-specific and unified settings, achieving superior accuracy and visual fidelity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 56 of its 86 references that are in the map. First posted on arXiv 7 Aug 2026.

Builds on

56 of 86 references.

References · 56

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  7. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  8. 2022Visual Prompt Tuningcited by 1,674
  9. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  10. 2014Deep Visual-Semantic Alignments for Generating Image Descriptionscited by 966
  11. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 934
  12. 2020Pre-Trained Image Processing Transformercited by 891
38 more
  1. 2021Multi-Stage Progressive Image Restorationcited by 813
  2. 2022Simple Baselines for Image Restorationcited by 701
  3. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
  4. 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 324
  5. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
  6. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
  7. 2022Visual Prompting via Image Inpaintingcited by 248
  8. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
  9. 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
  10. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
  11. 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
  12. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  13. 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
  14. 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
  15. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
  16. 2018Gated Fusion Network for Single Image Dehazingcited by 133
  17. 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 108
  18. 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 108
  19. 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
  20. 2019Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restorationcited by 73
  21. 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
  22. 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curationcited by 64
  23. 2021Structure-Preserving Deraining with Residue Channel Prior Guidancecited by 63
  24. 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditionscited by 62
  25. 2023Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restorationcited by 50
  26. 2020Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attentioncited by 45
  27. 2020DCSFN: Deep Cross-scale Fusion Network for Single Image Rain Removalcited by 44
  28. 2023Prompt-In-Prompt Learning for Universal Image Restorationcited by 43
  29. 2024Correlation Matching Transformation Transformers for UHD Image Restorationcited by 39
  30. 2023Language-driven All-in-one Adverse Weather Removalcited by 36
  31. 2023Improving Image Restoration through Removing Degradations in Textual Representationscited by 36
  32. 2023Textual Prompt Guided Image Restorationcited by 27
  33. 2020Joint Self-Attention and Scale-Aggregation for Self-Calibrated Deraining Networkcited by 25
  34. 2023SelfPromer: Self-Prompt Dehazing Transformers with Depth-Consistencycited by 24
  35. 2024Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraintcited by 24
  36. 2024Low-Light Image Enhancement via Generative Perceptual Priorscited by 21
  37. 2024Learning A Low-Level Vision Generalist via Visual Task Promptcited by 18
  38. 2022Online-updated High-order Collaborative Networks for Single Image Derainingcited by 13

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025VLM-Augmented Degradation Modeling for Image Restoration Under Adverse Weather Conditions
  2. 2025DA2Diff: Exploring Degradation-aware Adaptive Diffusion Priors for All-in-One Weather Restoration
  3. 2024Towards Real-World Adverse Weather Image Restoration: Enhancing Clearness and Semantics with Vision-Language Models
  4. 2025When Color-Space Decoupling Meets Diffusion for Adverse-Weather Image Restoration
  5. 2024Restore Anything Model via Efficient Degradation Adaptation
  6. 2025MODEM: A Morton-Order Degradation Estimation Mechanism for Adverse Weather Image Recovery
  7. 2026PVRF: All-in-one Adverse Weather Removal via Prior-modulated and Velocity-constrained Rectified Flow
  8. 2025MdaIF: Robust One-Stop Multi-Degradation-Aware Image Fusion with Language-Driven Semantics