RegisterBridgeMM: A Register-Centric Framework for RGB-Infrared Object Detection
Not on the map. Why?
Abstract (arXiv)
RGB-infrared (RGB-IR) object detection benefits from complementary visible and thermal cues, but effective fusion remains challenging under illumination changes, weather variation, and cluttered scenes. Existing RGB-IR fusion methods often trade expressive patch-level interaction for lighter but more constrained adaptation mechanisms. We empirically observe that pretrained register tokens contain both modality-shared and modality-specific information on paired RGB-IR inputs, suggesting that they can serve as a compact substrate for cross-modal communication. Building on this observation, we propose RegisterBridgeMM, a register-mediated fusion framework organized as a three-stage register lifecycle. Aggregate preserves per-modality register summarization inherited from pretraining; Bridge performs bidirectional register-to-patch reading with consensus-residual regulation; and Project translates the resulting register summary into spatially adaptive calibration of patch features. This register pathway avoids dense patch-to-patch cross-modal interaction while preserving the pretrained patch representation. With both backbone streams frozen, RegisterBridgeMM achieves the highest mAP50-95 among the evaluated methods on all four benchmarks: LLVIP, M3FD, DroneVehicle, and FLIR-Aligned.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 48 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
33 of 48 references.
References · 33
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2025DINOv3cited by 1,297
- 2023Vision Transformers Need Registerscited by 844
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
- 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 150
21 more
- 2022Multimodal Token Fusion for Vision Transformerscited by 132
- 2023Equivariant Multi-Modality Image Fusioncited by 98
- 2021Cross-Modality Fusion Transformer for Multispectral Object Detectioncited by 86
- 2020Improving Multispectral Pedestrian Detection by Addressing Modality Imbalance Problemscited by 82
- 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
- 2024Fusion-Mamba for Cross-modality Object Detectioncited by 67
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 57
- 2022Translation, Scale and Rotation: Cross-Modal Alignment Meets RGB-Infrared Vehicle Detectioncited by 49
- 2025Vision Transformers Don't Need Trained Registerscited by 39
- 2023Learning a Graph Neural Network with Cross Modality Interaction for Image Fusioncited by 28
- 2024DAMSDet: Dynamic Adaptive Multispectral Detection Transformer with Competitive Query Selection and Adaptive Feature Fusioncited by 28
- 2024DMM: Disparity-guided Multispectral Mamba for Oriented Object Detection in Remote Sensingcited by 19
- 2024Efficient Vision-Language Models by Summarizing Visual Tokens into Compact Registerscited by 19
- 2023TFDet: Target-Aware Fusion for RGB-T Pedestrian Detectioncited by 18
- 2024UniRGB-IR: A Unified Framework for Visible-Infrared Semantic Tasks via Adapter Tuningcited by 16
- 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detectioncited by 14
- 2023Cross-Modality Proposal-guided Feature Mining for Unregistered RGB-Thermal Pedestrian Detectioncited by 12
- 2024Optimizing Multispectral Object Detection: A Bag of Tricks and Comprehensive Benchmarkscited by 4
- 2026SLGNet: Synergizing Structural Priors and Language-Guided Modulation for Multimodal Object Detectioncited by 4
- 2025Leveraging Registers in Vision Transformers for Robust Adaptationcited by 3
- 2025IRDFusion: Iterative Relation-Map Difference guided Feature Fusion for Multispectral Object Detectioncited by 2
Built on by
Not cited yet.