Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blocks
Not on the map. Why?
Abstract (arXiv)
Multispectral images (e.g. visible and infrared) may be particularly useful when detecting objects with the same model in different environments (e.g. day/night outdoor scenes). To effectively use the different spectra, the main technical problem resides in the information fusion process. In this paper, we propose a new halfway feature fusion method for neural networks that leverages the complementary/consistency balance existing in multispectral features by adding to the network architecture, a particular module that cyclically fuses and refines each spectral feature. We evaluate the effectiveness of our fusion method on two challenging multispectral datasets for object detection. Our results show that implementing our Cyclic Fuse-and-Refine module in any network improves the performance on both datasets compared to other state-of-the-art multispectral object detection methods.
Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 3; 2023: 10; 2024: 21; 2025: 26; 2026: 21.
85 papers.
Sort:
By area:
- 2021Cross-Modality Fusion Transformer for Multispectral Object Detectioncited by 86
- 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
- 2021Multimodal Object Detection via Probabilistic Ensemblingcited by 67
- 2024Fusion-Mamba for Cross-modality Object Detectioncited by 67
- 2023Multi-modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusioncited by 54
- 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 45
- 2024DAMSDet: Dynamic Adaptive Multispectral Detection Transformer with Competitive Query Selection and Adaptive Feature Fusioncited by 28
- 2022Weakly Aligned Feature Fusion for Multimodal Object Detectioncited by 26
- 2022Emergent Visual Sensors for Autonomous Vehiclescited by 18
- 2023TFDet: Target-Aware Fusion for RGB-T Pedestrian Detectioncited by 18
- 2024Removal then Selection: A Coarse-to-Fine Fusion Perspective for RGB-Infrared Object Detectioncited by 16
- 2024UniRGB-IR: A Unified Framework for Visible-Infrared Semantic Tasks via Adapter Tuningcited by 16
38 more
- 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understandingcited by 16
- 2023RGB-X Object Detection via Scene-Specific Fusion Modulescited by 15
- 2023MS-DETR: Multispectral Pedestrian Detection Transformer with Loosely Coupled Fusion and Modality-Balanced Optimizationcited by 14
- 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detectioncited by 14
- 2021BAANet: Learning Bi-directional Adaptive Attention Gates for Multispectral Pedestrian Detectioncited by 13
- 2024Causal Mode Multiplexer: A Novel Framework for Unbiased Multispectral Pedestrian Detectioncited by 13
- 2025ThermalGen: Style-Disentangled Flow-Based Generative Models for RGB-to-Thermal Image Translationcited by 13
- 2024When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Datasetcited by 10
- 2024D3T: Distinctive Dual-Domain Teacher Zigzagging Across RGB-Thermal Gap for Domain-Adaptive Object Detectioncited by 9
- 2024Rethinking Early-Fusion Strategies for Improved Multispectral Object Detectioncited by 9
- 2025R-LiViT: A LiDAR-Visual-Thermal Dataset Enabling Vulnerable Road User Focused Roadside Perceptioncited by 9
- 2023HalluciDet: Hallucinating RGB Modality for Person Detection Through Privileged Informationcited by 8
- 2024Pedestrian Detection in Low-Light Conditions: A Comprehensive Surveycited by 8
- 2024CFMW: Cross-modality Fusion Mamba for Robust Object Detection under Adverse Weathercited by 8
- 2025M-SpecGene: Generalized Foundation Model for RGBT Multispectral Visioncited by 8
- 2024Visual Modality Prompt for Adapting Vision-Language Object Detectorscited by 7
- 2023Online Self-Supervised Thermal Water Segmentation for Aerial Vehiclescited by 6
- 2024MambaST: A Plug-and-Play Cross-Spectral Spatial-Temporal Fuser for Efficient Pedestrian Detectioncited by 6
- 2025Multispectral State-Space Feature Fusion: Bridging Shared and Cross-Parametric Interactions for Object Detectioncited by 6
- 2024MiPa: Mixed Patch Infrared-Visible Modality Agnostic Object Detectioncited by 5
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
- 2024DPDETR: Decoupled Position Detection Transformer for Infrared-Visible Object Detectioncited by 5
- 2025Learning A Robust RGB-Thermal Detector for Extreme Modality Imbalancecited by 5
- 2025C3-OWD: A Curriculum Cross-modal Contrastive Learning Framework for Open-World Detectioncited by 5
- 2022Robust Environment Perception for Automated Driving: A Unified Learning Pipeline for Visual-Infrared Object Detectioncited by 4
- 2024Modality Translation for Object Detection Adaptation Without Forgetting Prior Knowledgecited by 4
- 2024SeaDATE: Remedy Dual-Attention Transformer with Semantic Alignment via Contrast Learning for Multimodal Object Detectioncited by 4
- 2024Optimizing Multispectral Object Detection: A Bag of Tricks and Comprehensive Benchmarkscited by 4
- 2025SAGA: Semantic-Aware Gray color Augmentation for Visible-to-Thermal Domain Adaptation across Multi-View Drone and Ground-Based Vision Systemscited by 4
- 2026SLGNet: Synergizing Structural Priors and Language-Guided Modulation for Multimodal Object Detectioncited by 4
- 2023Cascaded information enhancement and cross-modal attention feature fusion for multispectral pedestrian detectioncited by 3
- 2024MSCoTDet: Language-driven Multi-modal Fusion for Improved Multispectral Pedestrian Detectioncited by 3
- 2024DiffX: Guide Your Layout to Cross-Modal Generative Modelingcited by 3
- 2025YOLOv11-RGBT: Towards a Comprehensive Single-Stage Multispectral Object Detection Frameworkcited by 3
- 2025RGBT-GroundBench: Visual Grounding Beyond RGB in Complex Real-World Scenarioscited by 3
- 2026TherA: Thermal-Aware Visual-Language Prompting for Controllable RGB-to-Thermal Infrared Translationcited by 3
- 2021Partially fake it till you make it: mixing real and fake thermal images for improved object detectioncited by 2
- 2023Multimodal Object Detection in Remote Sensingcited by 1
50 most cited of 85 All 85 (JSON)
- 2026Residual Optimal Transport-Based Experts Collaboration Towards Modality-Aware Infrared-Visible Object Detection3 Sep 2026
- 2026A2DINOv3: Rethinking Multi-Modal Object Detection via Socialized Collaboration21 Aug 2026
- 2026SuppreSensing: Expert-Guided Feature Recalibration and Discrepancy Augmentation for Multimodal Object Detection21 Aug 2026
- 2026ProtoHGF-Net: Prototype HyperGraph Fusion with Intra-modal Calibration for RGBT Object Detection12 Aug 2026
- 2026InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detection11 Aug 2026
- 2026CFGPNet: Cross-Attention-Based Fused Gradient Programmed Network Framework for Multispectral Object Detection6 Aug 2026
- 2026Descriptor: LYNRED Mobility Dataset Multimodal Detection Subset (LYNRED-MDS)2 Jul 2026
- 2026Dual Sparse Aggregation Transformer for Multispectral Object Detection30 Jun 2026
- 2026Efficient RGB-T Object Detection via Sparse Cross-Modality Fusion29 Jun 2026
- 2026Towards UAV Detection in the Real World: A New Multispectral Dataset UAVNet-MS and a New Method20 May 2026
- 2026A Causally Grounded Taxonomy for Image Degradation Robustness Evaluation15 May 2026
- 2026Physical Adversarial Clothing Evades Visible-Thermal Detectors via Non-Overlapping RGB-T Pattern6 May 2026
38 more
- 2026Tri-Modal Fusion Transformers for UAV-based Object Detection17 Apr 2026
- 2026Bridging the RGB-IR Gap: Consensus and Discrepancy Modeling for Text-Guided Multispectral Detection13 Apr 2026
- 2026DLRMamba: Distilling Low-Rank Mamba for Edge Multispectral Fusion Object Detection6 Mar 2026
- 2026TherA: Thermal-Aware Visual-Language Prompting for Controllable RGB-to-Thermal Infrared Translation23 Feb 2026
- 2026M2I2HA: Multi-modal Object Detection Based on Intra- and Inter-Modal Hypergraph Attention21 Jan 2026
- 2026Disentangle Object and Non-object Infrared Features via Language Guidance14 Jan 2026
- 2026Modality-Decoupled RGB-Thermal Object Detector via Query Fusion13 Jan 2026
- 2026SLGNet: Synergizing Structural Priors and Language-Guided Modulation for Multimodal Object Detection5 Jan 2026
- 2026Modality Dominance-Aware Optimization for Embodied RGB-Infrared Perception2 Jan 2026
- 2025RGBT-GroundBench: Visual Grounding Beyond RGB in Complex Real-World Scenarios31 Dec 2025
- 2025From Words to Wavelengths: VLMs for Few-Shot Multispectral Object Detection17 Dec 2025
- 2025MM-DETR: An Efficient Multimodal Detection Transformer with Mamba-Driven Dual-Granularity Fusion and Frequency-Aware Modality Adapters29 Nov 2025
- 2025Representation Space Constrained Learning with Modality Decoupling for Multimodal Object Detection19 Nov 2025
- 2025On Modality Incomplete Infrared-Visible Object Detection: An Architecture Compatibility Perspective9 Nov 2025
- 2025Contrast-Guided Cross-Modal Distillation for Thermal Object Detection3 Nov 2025
- 2025From Camera-Based Sensing to Reasoning: A Comprehensive Review Toward Proactive Vulnerable Road User Safety30 Sep 2025
- 2025ThermalGen: Style-Disentangled Flow-Based Generative Models for RGB-to-Thermal Image Translation29 Sep 2025
- 2025C3-OWD: A Curriculum Cross-modal Contrastive Learning Framework for Open-World Detection27 Sep 2025
- 2025HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detection28 Aug 2025
- 2025DOD-SA: Infrared-Visible Decoupled Object Detection with Single-Modality Annotations14 Aug 2025
- 2025Infrared Object Detection with Ultra Small ConvNets: Is ImageNet Pretraining Still Useful?4 Aug 2025
- 2025WiSE-OD: Benchmarking Robustness in Infrared Object Detection25 Jul 2025
- 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection24 Jul 2025
- 2025M-SpecGene: Generalized Foundation Model for RGBT Multispectral Vision22 Jul 2025
- 2025Multispectral State-Space Feature Fusion: Bridging Shared and Cross-Parametric Interactions for Object Detection19 Jul 2025
- 2025Layer Decomposition and Morphological Reconstruction for Task-Oriented Infrared Image Enhancement29 Jun 2025
- 2025YOLOv11-RGBT: Towards a Comprehensive Single-Stage Multispectral Object Detection Framework17 Jun 2025
- 2025Feature Fusion and Knowledge-Distilled Multi-Modal Multi-Target Detection31 May 2025
- 2025Learning A Robust RGB-Thermal Detector for Extreme Modality Imbalance28 May 2025
- 2025Multispectral Detection Transformer with Infrared-Centric Feature Fusion21 May 2025
- 2025A High-Performance Thermal Infrared Object Detection Framework with Centralized Regulation16 May 2025
- 2025SAGA: Semantic-Aware Gray color Augmentation for Visible-to-Thermal Domain Adaptation across Multi-View Drone and Ground-Based Vision Systems22 Apr 2025
- 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understanding24 Mar 2025
- 2025R-LiViT: A LiDAR-Visual-Thermal Dataset Enabling Vulnerable Road User Focused Roadside Perception21 Mar 2025
- 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaption18 Jan 2025
- 2024Visual Modality Prompt for Adapting Vision-Language Object Detectors1 Dec 2024
- 2024Optimizing Multispectral Object Detection: A Bag of Tricks and Comprehensive Benchmarks27 Nov 2024
- 2024SeaDATE: Remedy Dual-Attention Transformer with Semantic Alignment via Contrast Learning for Multimodal Object Detection15 Oct 2024
50 newest of 85 All 85 (JSON)
- 2024Fusion-Mamba for Cross-modality Object Detectioncited by 67
- 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detectioncited by 14
- 2024CFMW: Cross-modality Fusion Mamba for Robust Object Detection under Adverse Weathercited by 8
- 2026DLRMamba: Distilling Low-Rank Mamba for Edge Multispectral Fusion Object Detectioncited by 1
- 2025HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detectioncited by 0
- 2025MM-DETR: An Efficient Multimodal Detection Transformer with Mamba-Driven Dual-Granularity Fusion and Frequency-Aware Modality Adapterscited by 0
- 2026DLRMamba: Distilling Low-Rank Mamba for Edge Multispectral Fusion Object Detection6 Mar 2026
- 2025MM-DETR: An Efficient Multimodal Detection Transformer with Mamba-Driven Dual-Granularity Fusion and Frequency-Aware Modality Adapters29 Nov 2025
- 2025HiddenObject: Modality-Agnostic Fusion for Multimodal Hidden Object Detection28 Aug 2025
- 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detection24 Jul 2025
- 2024CFMW: Cross-modality Fusion Mamba for Robust Object Detection under Adverse Weather25 Apr 2024
- 2024Fusion-Mamba for Cross-modality Object Detection14 Apr 2024
- 2021Cross-Modality Fusion Transformer for Multispectral Object Detectioncited by 86
- 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
- 2021Multimodal Object Detection via Probabilistic Ensemblingcited by 67
- 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 45
- 2024DAMSDet: Dynamic Adaptive Multispectral Detection Transformer with Competitive Query Selection and Adaptive Feature Fusioncited by 28
- 2022Weakly Aligned Feature Fusion for Multimodal Object Detectioncited by 26
- 2022Emergent Visual Sensors for Autonomous Vehiclescited by 18
- 2023TFDet: Target-Aware Fusion for RGB-T Pedestrian Detectioncited by 18
- 2024Removal then Selection: A Coarse-to-Fine Fusion Perspective for RGB-Infrared Object Detectioncited by 16
- 2024UniRGB-IR: A Unified Framework for Visible-Infrared Semantic Tasks via Adapter Tuningcited by 16
- 2023RGB-X Object Detection via Scene-Specific Fusion Modulescited by 15
- 2023MS-DETR: Multispectral Pedestrian Detection Transformer with Loosely Coupled Fusion and Modality-Balanced Optimizationcited by 14
12 most cited of 76 All 76 (JSON)
- 2026Residual Optimal Transport-Based Experts Collaboration Towards Modality-Aware Infrared-Visible Object Detection3 Sep 2026
- 2026A2DINOv3: Rethinking Multi-Modal Object Detection via Socialized Collaboration21 Aug 2026
- 2026SuppreSensing: Expert-Guided Feature Recalibration and Discrepancy Augmentation for Multimodal Object Detection21 Aug 2026
- 2026ProtoHGF-Net: Prototype HyperGraph Fusion with Intra-modal Calibration for RGBT Object Detection12 Aug 2026
- 2026InterPruner: Interactive Structured Pruning via Taylor-Implicit Criterion and Language-Prior Modulator for Multimodal Object Detection11 Aug 2026
- 2026CFGPNet: Cross-Attention-Based Fused Gradient Programmed Network Framework for Multispectral Object Detection6 Aug 2026
- 2026Descriptor: LYNRED Mobility Dataset Multimodal Detection Subset (LYNRED-MDS)2 Jul 2026
- 2026Dual Sparse Aggregation Transformer for Multispectral Object Detection30 Jun 2026
- 2026Efficient RGB-T Object Detection via Sparse Cross-Modality Fusion29 Jun 2026
- 2026Towards UAV Detection in the Real World: A New Multispectral Dataset UAVNet-MS and a New Method20 May 2026
- 2026A Causally Grounded Taxonomy for Image Degradation Robustness Evaluation15 May 2026
- 2026Physical Adversarial Clothing Evades Visible-Thermal Detectors via Non-Overlapping RGB-T Pattern6 May 2026
12 newest of 76 All 76 (JSON)