WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection
On the map: State-space sequence models (S4, Mamba) → Point clouds, detection and remote sensing
Abstract (arXiv)
Leveraging the complementary characteristics of visible (RGB) and infrared (IR) imagery offers significant potential for improving object detection. In this paper, we propose WaveMamba, a cross-modality fusion method that efficiently integrates the unique and complementary frequency features of RGB and IR decomposed by Discrete Wavelet Transform (DWT). An improved detection head incorporating the Inverse Discrete Wavelet Transform (IDWT) is also proposed to reduce information loss and produce the final detection results. The core of our approach is the introduction of WaveMamba Fusion Block (WMFB), which facilitates comprehensive fusion across low-/high-frequency sub-bands. Within WMFB, the Low-frequency Mamba Fusion Block (LMFB), built upon the Mamba framework, first performs initial low-frequency feature fusion with channel swapping, followed by deep fusion with an advanced gated attention mechanism for enhanced integration. High-frequency features are enhanced using a strategy that applies an ``absolute maximum" fusion approach. These advancements lead to significant performance gains, with our method surpassing state-of-the-art approaches and achieving average mAP improvements of 4.5% on four benchmarks.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Point clouds, detection and remote sensing, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 38 of its 98 references that are in the map. First posted on arXiv 24 Jul 2025.
Builds on
38 of 98 references.
Closest ancestors · 2
Same direction, newest first
- 2024DMM: Disparity-guided Multispectral Mamba for Oriented Object Detection in Remote Sensing11 Jul
- 2024S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusion31 May
Other references · 36
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2024VMamba: Visual State Space Modelcited by 969
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 231
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
- 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 152
- 2023Equivariant Multi-Modality Image Fusioncited by 99
- 2023Wavelet-based Fourier Information Interaction with Frequency Diffusion Adjustment for Underwater Image Restorationcited by 88
- 2021Cross-Modality Fusion Transformer for Multispectral Object Detectioncited by 86
- 2020Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blockscited by 85
- 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 84
24 more
- 2016Multispectral Deep Neural Networks for Pedestrian Detectioncited by 82
- 2022Wave-ViT: Unifying Wavelet and Transformers for Visual Representation Learningcited by 78
- 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
- 2018Illumination-aware Faster R-CNN for Robust Multispectral Pedestrian Detectioncited by 74
- 2024Wavelet Convolutions for Large Receptive Fieldscited by 74
- 2020DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusioncited by 73
- 2024Pan-Mamba: Effective pan-sharpening with State Space Modelcited by 73
- 2021Multimodal Object Detection via Probabilistic Ensemblingcited by 68
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 58
- 2022Translation, Scale and Rotation: Cross-Modal Alignment Meets RGB-Infrared Vehicle Detectioncited by 50
- 2021Cross-Modality Attentive Feature Fusion for Object Detection in Multispectral Remote Sensing Imagerycited by 45
- 2023Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Taskscited by 41
- 2019Borrow from Anywhere: Pseudo Multi-modal Object Detection in Thermal Imagerycited by 38
- 2022Multi-stage image denoising with the wavelet transformcited by 37
- 2023Learning a Graph Neural Network with Cross Modality Interaction for Image Fusioncited by 28
- 2024DAMSDet: Dynamic Adaptive Multispectral Detection Transformer with Competitive Query Selection and Adaptive Feature Fusioncited by 28
- 2021SDWNet: A Straight Dilated Network with Wavelet Transformation for Image Deblurringcited by 26
- 2024Learning Adaptive Fusion Bank for Multi-modal Salient Object Detectioncited by 19
- 2024Removal then Selection: A Coarse-to-Fine Fusion Perspective for RGB-Infrared Object Detectioncited by 16
- 2024TinyViM: Frequency Decoupling for Tiny Hybrid Vision Mambacited by 15
- 2023Cross-Modality Proposal-guided Feature Mining for Unregistered RGB-Thermal Pedestrian Detectioncited by 12
- 2024TSJNet: A Multi-modality Target and Semantic Awareness Joint-driven Image Fusion Networkcited by 10
- 2024MambaST: A Plug-and-Play Cross-Spectral Spatial-Temporal Fuser for Efficient Pedestrian Detectioncited by 6
- 2021Image restoration quality assessment based on regional differential information entropycited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 11.
14 papers.
Sort:
By area:
- 2026SLGNet: Synergizing Structural Priors and Language-Guided Modulation for Multimodal Object Detectioncited by 4
- 2025AlignFreeNet: Is Cross-Modal Pre-Alignment Necessary? An End-to-End Alignment-Free Lightweight Network for Visible-Infrared Object Detectioncited by 1
- 2025Representation Space Constrained Learning with Modality Decoupling for Multimodal Object Detectioncited by 1
- 2026Bridging the RGB-IR Gap: Consensus and Discrepancy Modeling for Text-Guided Multispectral Detectioncited by 1
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perceptioncited by 1
- 2025MM-DETR: An Efficient Multimodal Detection Transformer with Mamba-Driven Dual-Granularity Fusion and Frequency-Aware Modality Adapterscited by 0
- 2026InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detectioncited by 0
- 2026Geometric Causal Modelscited by 0
- 2026DRPFNet: Dual-domain Residual Progressive Fusion Network for RGB-Thermal Object Detectioncited by 0
- 2026RegisterBridgeMM: A Register-Centric Framework for RGB-Infrared Object Detectioncited by 0
- 2026InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detectioncited by 0
- 2026Aligned Radiometric RGB-Thermal Fusion for UAV Facade Anomaly Screeningcited by 0
- 2026SAGE: Source-Anchored Guidance via Frequency Equalization for Hierarchical RGB-T Alignment and Fusion25 Sep 2026
- 2026FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detection24 Sep 2026
- 2026Aligned Radiometric RGB-Thermal Fusion for UAV Facade Anomaly Screening11 Sep 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detection11 Aug 2026
- 2026RegisterBridgeMM: A Register-Centric Framework for RGB-Infrared Object Detection5 Aug 2026
- 2026DRPFNet: Dual-domain Residual Progressive Fusion Network for RGB-Thermal Object Detection4 Aug 2026
- 2026Geometric Causal Models6 Jul 2026
- 2026InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection4 Jul 2026
- 2026Bridging the RGB-IR Gap: Consensus and Discrepancy Modeling for Text-Guided Multispectral Detection13 Apr 2026
- 2026SLGNet: Synergizing Structural Priors and Language-Guided Modulation for Multimodal Object Detection5 Jan 2026
- 2025MM-DETR: An Efficient Multimodal Detection Transformer with Mamba-Driven Dual-Granularity Fusion and Frequency-Aware Modality Adapters29 Nov 2025
- 2026SLGNet: Synergizing Structural Priors and Language-Guided Modulation for Multimodal Object Detectioncited by 4
- 2025AlignFreeNet: Is Cross-Modal Pre-Alignment Necessary? An End-to-End Alignment-Free Lightweight Network for Visible-Infrared Object Detectioncited by 1
- 2025Representation Space Constrained Learning with Modality Decoupling for Multimodal Object Detectioncited by 1
- 2026Bridging the RGB-IR Gap: Consensus and Discrepancy Modeling for Text-Guided Multispectral Detectioncited by 1
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perceptioncited by 1
- 2026InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detectioncited by 0
- 2026Geometric Causal Modelscited by 0
- 2026DRPFNet: Dual-domain Residual Progressive Fusion Network for RGB-Thermal Object Detectioncited by 0
- 2026RegisterBridgeMM: A Register-Centric Framework for RGB-Infrared Object Detectioncited by 0
- 2026InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detectioncited by 0
- 2026Aligned Radiometric RGB-Thermal Fusion for UAV Facade Anomaly Screeningcited by 0
- 2026FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detectioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026SAGE: Source-Anchored Guidance via Frequency Equalization for Hierarchical RGB-T Alignment and Fusion25 Sep 2026
- 2026FoCal: Frequency-Oriented Cross-Modal Interaction and Spectral Calibration for Aerial Visible-Infrared Object Detection24 Sep 2026
- 2026Aligned Radiometric RGB-Thermal Fusion for UAV Facade Anomaly Screening11 Sep 2026
- 2026GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception28 Aug 2026
- 2026InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detection11 Aug 2026
- 2026RegisterBridgeMM: A Register-Centric Framework for RGB-Infrared Object Detection5 Aug 2026
- 2026DRPFNet: Dual-domain Residual Progressive Fusion Network for RGB-Thermal Object Detection4 Aug 2026
- 2026Geometric Causal Models6 Jul 2026
- 2026InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detection4 Jul 2026
- 2026Bridging the RGB-IR Gap: Consensus and Discrepancy Modeling for Text-Guided Multispectral Detection13 Apr 2026
- 2026SLGNet: Synergizing Structural Priors and Language-Guided Modulation for Multimodal Object Detection5 Jan 2026
- 2025Representation Space Constrained Learning with Modality Decoupling for Multimodal Object Detection19 Nov 2025
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Exploring State Space Model in Wavelet Domain: An Infrared and Visible Image Fusion Network via Wavelet Transform and State Space Model
- 2024MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detection
- 2025Multispectral Detection Transformer with Infrared-Centric Feature Fusion
- 2024Fusion-Mamba for Cross-modality Object Detection
- 2025HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detection
- 2024IRSRMamba: Infrared Image Super-Resolution via Mamba-based Wavelet Transform Feature Modulation Model
- 2024WaveMamba: Spatial-Spectral Wavelet Mamba for Hyperspectral Image Classification
- 2025LEAF-Mamba: Local Emphatic and Adaptive Fusion State Space Model for RGB-D Salient Object Detection