The Solution for the GAIIC2024 RGB-TIR object detection Challenge
Not on the map. Why?
Abstract (arXiv)
This report introduces a solution to The task of RGB-TIR object detection from the perspective of unmanned aerial vehicles. Unlike traditional object detection methods, RGB-TIR object detection aims to utilize both RGB and TIR images for complementary information during detection. The challenges of RGB-TIR object detection from the perspective of unmanned aerial vehicles include highly complex image backgrounds, frequent changes in lighting, and uncalibrated RGB-TIR image pairs. To address these challenges at the model level, we utilized a lightweight YOLOv9 model with extended multi-level auxiliary branches that enhance the model's robustness, making it more suitable for practical applications in unmanned aerial vehicle scenarios. For image fusion in RGB-TIR detection, we incorporated a fusion module into the backbone network to fuse images at the feature level, implicitly addressing calibration issues. Our proposed method achieved an mAP score of 0.516 and 0.543 on A and B benchmarks respectively while maintaining the highest inference speed among all models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 23 references that are in the map. First posted on arXiv 4 Jul 2024.
Builds on
13 of 23 references.
References · 13
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 425
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 274
- 2020Detection and Tracking Meet Drones Challengecited by 263
- 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 152
- 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 58
- 2022Translation, Scale and Rotation: Cross-Modal Alignment Meets RGB-Infrared Vehicle Detectioncited by 50
- 2021Semi-Supervised Multi-Modal Multi-Instance Multi-Label Deep Network with Optimal Transportcited by 28
- 2021Exploiting Cross-Modal Prediction and Relation Consistency for Semi-Supervised Image Captioningcited by 23
1 more
Built on by
Not cited yet.