mlsanityData to 7 Oct 2026

Semantics and Content Matter: Towards Multi-Prior Hierarchical Mamba for Image Deraining

arXiv 2511.13113 ↗First posted 17 Nov 2025cs.CVcited by 0

On the map: State-space sequence models (S4, Mamba) → Vision Mamba backbones

Abstract (arXiv)

Rain significantly degrades the performance of computer vision systems, particularly in applications like autonomous driving and video surveillance. While existing deraining methods have made considerable progress, they often struggle with fidelity of semantic and spatial details. To address these limitations, we propose the Multi-Prior Hierarchical Mamba (MPHM) network for image deraining. This novel architecture synergistically integrates macro-semantic textual priors (CLIP) for task-level semantic guidance and micro-structural visual priors (DINOv2) for scene-aware structural information. To alleviate potential conflicts between heterogeneous priors, we devise a progressive Priors Fusion Injection (PFI) that strategically injects complementary cues at different decoder levels. Meanwhile, we equip the backbone network with an elaborate Hierarchical Mamba Module (HMM) to facilitate robust feature representation, featuring a Fourier-enhanced dual-path design that concurrently addresses global context modeling and local detail recovery. Comprehensive experiments demonstrate MPHM's state-of-the-art performance, achieving a 0.57 dB PSNR gain on the Rain200H dataset while delivering superior generalization on real-world rainy scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Vision Mamba backbones, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 26 of its 45 references that are in the map. First posted on arXiv 17 Nov 2025.

Builds on

26 of 45 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  5. 2017Decoupled Weight Decay Regularizationcited by 1,722
  6. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  7. 2020Pre-Trained Image Processing Transformercited by 891
  8. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  9. 2021Multi-Stage Progressive Image Restorationcited by 813
  10. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
  11. 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 271
  12. 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
14 more
  1. 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
  2. 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
  3. 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
  4. 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
  5. 2020A Model-driven Deep Neural Network for Single Image Rain Removalcited by 125
  6. 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 108
  7. 2021Structure-Preserving Deraining with Residue Channel Prior Guidancecited by 63
  8. 2024Bidirectional Multi-Scale Implicit Neural Representations for Image Derainingcited by 54
  9. 2020DCSFN: Deep Cross-scale Fusion Network for Single Image Rain Removalcited by 44
  10. 2023From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removalcited by 39
  11. 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
  12. 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Derainingcited by 32
  13. 2023Multi-task Image Restoration Guided By Robust DINO Featurescited by 14
  14. 2024LLMRA: Multi-modal Large Language Model based Restoration Assistantcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026S3VD: Semantic-Guidance Spatio-Temporal Scanning for Video Deraining
  2. 2025MambaTrans: Multimodal Fusion Image Translation via Large Language Model Priors for Downstream Visual Tasks
  3. 2025DeRainMamba: A Frequency-Aware State Space Model with Detail Enhancement for Image Deraining
  4. 2025Mamba as a Bridge: Where Vision Foundation Models Meet Vision Language Models for Domain-Generalized Semantic Segmentation
  5. 2024LocalMamba: Visual State Space Model with Windowed Selective Scan
  6. 2024MTMamba: Enhancing Multi-Task Dense Scene Understanding by Mamba-Based Decoders
  7. 2024Mamba-R: Vision Mamba ALSO Needs Registers
  8. 2025PRISM: Progressive Rain removal with Integrated State-space Modeling