mlsanityData to 7 Oct 2026

RGB-X Object Detection via Scene-Specific Fusion Modules

arXiv 2310.19372 ↗First posted 30 Oct 2023cs.CV cs.AI cs.ROcited by 15

Not on the map. Why?

Abstract (arXiv)

Multimodal deep sensor fusion has the potential to enable autonomous vehicles to visually understand their surrounding environments in all weather conditions. However, existing deep sensor fusion methods usually employ convoluted architectures with intermingled multimodal features, requiring large coregistered multimodal datasets for training. In this work, we present an efficient and modular RGB-X fusion network that can leverage and fuse pretrained single-modal models via scene-specific fusion modules, thereby enabling joint input-adaptive network architectures to be created using small, coregistered multimodal datasets. Our experiments demonstrate the superiority of our method compared to existing works on RGB-thermal and RGB-gated datasets, performing fusion using only a small amount of additional parameters. Our code is available at https://github.com/dsriaditya999/RGBXFusion.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 29 of its 44 references that are in the map. First posted on arXiv 30 Oct 2023.

Builds on

29 of 44 references.

References · 29

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  4. 2020End-to-End Object Detection with Transformerscited by 7,384
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  7. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  8. 2018YOLOv3: An Incremental Improvementcited by 2,652
  9. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  10. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  11. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,282
  12. 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
17 more
  1. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 572
  2. 2021Carbon Emissions and Large Neural Network Trainingcited by 561
  3. 2019Object Detection in 20 Years: A Surveycited by 528
  4. 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 313
  5. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
  6. 2020Deep Continuous Fusion for Multi-Sensor 3D Object Detectioncited by 263
  7. 2017PointFusion: Deep Sensor Fusion for 3D Bounding Box Estimationcited by 170
  8. 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 150
  9. 2021Cross-Modality Fusion Transformer for Multispectral Object Detectioncited by 86
  10. 2020Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blockscited by 85
  11. 2016Multispectral Deep Neural Networks for Pedestrian Detectioncited by 82
  12. 2021Multimodal Object Detection via Probabilistic Ensemblingcited by 67
  13. 2021SA-Net: Shuffle Attention for Deep Convolutional Neural Networkscited by 54
  14. 2023Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Taskscited by 41
  15. 2021BM-NAS: Bilevel Multimodal Neural Architecture Searchcited by 13
  16. 2022Unsupervised RGB-to-Thermal Domain Adaptation via Multi-Domain Attention Networkcited by 13
  17. 2023Online Self-Supervised Thermal Water Segmentation for Aerial Vehiclescited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 2; 2026: 7.

15 papers.

Sort:

  1. 2024Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectivescited by 22
  2. 2024Caltech Aerial RGB-Thermal Dataset in the Wildcited by 19
  3. 2024Pixel-aligned RGB-NIR Stereo Imaging and Dataset for Robot Visioncited by 7
  4. 2025MonoTher-Depth: Enhancing Thermal Depth Estimation via Confidence-Aware Distillationcited by 5
  5. 2024IV-tuning: Parameter-Efficient Transfer Learning for Infrared-Visible Taskscited by 1
  6. 2024IVGF: The Fusion-Guided Infrared and Visible General Frameworkcited by 0
  7. 2024OSSA: Unsupervised One-Shot Style Adaptationcited by 0
  8. 2025VLC Fusion: Vision-Language Conditioned Sensor Fusion for Robust Object Detectioncited by 0
  9. 2026No Calibration, No Depth, No Problem: Cross-Sensor View Synthesis with 3D Consistencycited by 0
  10. 2026SpectraDINO: Modality-Conditioned Adaptation of RGB Vision Foundation Models Across Infrared Bandscited by 0
  11. 2026Efficient RGB-T Object Detection via Sparse Cross-Modality Fusioncited by 0
  12. 2026Descriptor: LYNRED Mobility Dataset Multimodal Detection Subset (LYNRED-MDS)cited by 0
3 more
  1. 2026InfraNet: Quality-Aware RGB Guidance for Efficient Infrared Object Detectioncited by 0
  2. 2026LDFE: Laplacian Decoupled Feature Enhancement Block for Dual-Stream CNN-based RGB-IR Object Detectioncited by 0
  3. 2026RSFusionDet: Underwater RGB-Sonar Multimodal Object Detectioncited by 0