mlsanityData to 7 Oct 2026

RegisterBridgeMM: A Register-Centric Framework for RGB-Infrared Object Detection

arXiv 2608.04833 ↗First posted 5 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

RGB-infrared (RGB-IR) object detection benefits from complementary visible and thermal cues, but effective fusion remains challenging under illumination changes, weather variation, and cluttered scenes. Existing RGB-IR fusion methods often trade expressive patch-level interaction for lighter but more constrained adaptation mechanisms. We empirically observe that pretrained register tokens contain both modality-shared and modality-specific information on paired RGB-IR inputs, suggesting that they can serve as a compact substrate for cross-modal communication. Building on this observation, we propose RegisterBridgeMM, a register-mediated fusion framework organized as a three-stage register lifecycle. Aggregate preserves per-modality register summarization inherited from pretraining; Bridge performs bidirectional register-to-patch reading with consensus-residual regulation; and Project translates the resulting register summary into spatially adaptive calibration of patch features. This register pathway avoids dense patch-to-patch cross-modal interaction while preserving the pretrained patch representation. With both backbone streams frozen, RegisterBridgeMM achieves the highest mAP50-95 among the evaluated methods on all four benchmarks: LLVIP, M3FD, DroneVehicle, and FLIR-Aligned.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 48 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

33 of 48 references.

References · 33

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  5. 2025DINOv3cited by 1,297
  6. 2023Vision Transformers Need Registerscited by 844
  7. 2022Vision Transformer Adapter for Dense Predictionscited by 564
  8. 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
  9. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
  10. 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
  11. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
  12. 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 150
21 more
  1. 2022Multimodal Token Fusion for Vision Transformerscited by 132
  2. 2023Equivariant Multi-Modality Image Fusioncited by 98
  3. 2021Cross-Modality Fusion Transformer for Multispectral Object Detectioncited by 86
  4. 2020Improving Multispectral Pedestrian Detection by Addressing Modality Imbalance Problemscited by 82
  5. 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
  6. 2024Fusion-Mamba for Cross-modality Object Detectioncited by 67
  7. 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 57
  8. 2022Translation, Scale and Rotation: Cross-Modal Alignment Meets RGB-Infrared Vehicle Detectioncited by 49
  9. 2025Vision Transformers Don't Need Trained Registerscited by 39
  10. 2023Learning a Graph Neural Network with Cross Modality Interaction for Image Fusioncited by 28
  11. 2024DAMSDet: Dynamic Adaptive Multispectral Detection Transformer with Competitive Query Selection and Adaptive Feature Fusioncited by 28
  12. 2024DMM: Disparity-guided Multispectral Mamba for Oriented Object Detection in Remote Sensingcited by 19
  13. 2024Efficient Vision-Language Models by Summarizing Visual Tokens into Compact Registerscited by 19
  14. 2023TFDet: Target-Aware Fusion for RGB-T Pedestrian Detectioncited by 18
  15. 2024UniRGB-IR: A Unified Framework for Visible-Infrared Semantic Tasks via Adapter Tuningcited by 16
  16. 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detectioncited by 14
  17. 2023Cross-Modality Proposal-guided Feature Mining for Unregistered RGB-Thermal Pedestrian Detectioncited by 12
  18. 2024Optimizing Multispectral Object Detection: A Bag of Tricks and Comprehensive Benchmarkscited by 4
  19. 2026SLGNet: Synergizing Structural Priors and Language-Guided Modulation for Multimodal Object Detectioncited by 4
  20. 2025Leveraging Registers in Vision Transformers for Robust Adaptationcited by 3
  21. 2025IRDFusion: Iterative Relation-Map Difference guided Feature Fusion for Multispectral Object Detectioncited by 2

Built on by

Not cited yet.