OGMN: Occlusion-guided Multi-task Network for Object Detection in UAV Images
Not on the map. Why?
Abstract (arXiv)
Occlusion between objects is one of the overlooked challenges for object detection in UAV images. Due to the variable altitude and angle of UAVs, occlusion in UAV images happens more frequently than that in natural scenes. Compared to occlusion in natural scene images, occlusion in UAV images happens with feature confusion problem and local aggregation characteristic. And we found that extracting or localizing occlusion between objects is beneficial for the detector to address this challenge. According to this finding, the occlusion localization task is introduced, which together with the object detection task constitutes our occlusion-guided multi-task network (OGMN). The OGMN contains the localization of occlusion and two occlusion-guided multi-task interactions. In detail, an occlusion estimation module (OEM) is proposed to precisely localize occlusion. Then the OGMN utilizes the occlusion localization results to implement occlusion-guided detection with two multi-task interactions. One interaction for the guide is between two task decoders to address the feature confusion problem, and an occlusion decoupling head (ODH) is proposed to replace the general detection head. Another interaction for guide is designed in the detection process according to local aggregation characteristic, and a two-phase progressive refinement process (TPP) is proposed to optimize the detection process. Extensive experiments demonstrate the effectiveness of our OGMN on the Visdrone and UAVDT datasets. In particular, our OGMN achieves 35.0% mAP on the Visdrone dataset and outperforms the baseline by 5.3%. And our OGMN provides a new insight for accurate occlusion localization and achieves competitive detection performance.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 33 of its 61 references that are in the map. First posted on arXiv 24 Apr 2023.
Builds on
33 of 61 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
- 2018Path Aggregation Network for Instance Segmentationcited by 798
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
21 more
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 579
- 2018The Unmanned Aerial Vehicle Benchmark: Object Detection and Trackingcited by 208
- 2018Acquisition of Localization Confidence for Accurate Object Detectioncited by 176
- 2017CityPersons: A Diverse Dataset for Pedestrian Detectioncited by 172
- 2020FCOS: A simple and strong anchor-free object detectorcited by 171
- 2022Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNscited by 155
- 2019Rethinking Classification and Localization for Object Detectioncited by 98
- 2019Clustered Object Detection in Aerial Imagescited by 83
- 2020Revisiting the Sibling Head in Object Detectorcited by 82
- 2017Repulsion Loss: Detecting Pedestrians in a Crowdcited by 62
- 2020Density Map Guided Object Detection in Aerial Imagescited by 56
- 2022Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmarkcited by 56
- 2020Compositional Convolutional Neural Networks: A Deep Architecture with Innate Robustness to Partial Occlusioncited by 47
- 2019Oriented Objects as pairs of Middle Linescited by 43
- 2020HRDNet: High-resolution Detection Network for Small Objectscited by 25
- 2020AMRNet: Chips Augmentation in Aerial Images Object Detectioncited by 13
- 2019Alleviating Feature Confusion for Generative Zero-shot Learningcited by 10
- 2020Learning a Unified Sample Weighting Network for Object Detectioncited by 10
- 2021Artificial and beneficial -- Exploiting artificial images for aerial vehicle detectioncited by 3
- 2019Localizing Occluders with Compositional Convolutional Networkscited by 1
Built on by
Citing papers per year: 2024: 6; 2025: 2.
8 papers.
- 2024RingMo-Aerial: An Aerial Remote Sensing Foundation Model With Affine Transformation Contrastive Learningcited by 15
- 2024HazyDet: Open-Source Benchmark for Drone-View Object Detection with Depth-Cues in Hazy Scenescited by 15
- 2024SDL-MVS: View Space and Depth Deformable Learning Paradigm for Multi-View Stereo Reconstruction in Remote Sensingcited by 3
- 2024SCLNet: A Scale-Robust Complementary Learning Network for Object Detection in UAV Imagescited by 1
- 2025Language-guided Learning for Object Detection Tackling Multiple Variations in Aerial Imagescited by 1
- 2025Teaching in adverse scenes: a statistically feedback-driven threshold and mask adjustment teacher-student framework for object detection in UAV images under adverse scenescited by 1
- 2024Twin Deformable Point Convolutions for Point Cloud Semantic Segmentation in Remote Sensing Scenescited by 0
- 2024UDHF2-Net: Uncertainty-diffusion-model-based High-Frequency TransFormer Network for Remotely Sensed Imagery Interpretationcited by 0
- 2025Teaching in adverse scenes: a statistically feedback-driven threshold and mask adjustment teacher-student framework for object detection in UAV images under adverse scenes12 Jun 2025
- 2025Language-guided Learning for Object Detection Tackling Multiple Variations in Aerial Images29 May 2025
- 2024HazyDet: Open-Source Benchmark for Drone-View Object Detection with Depth-Cues in Hazy Scenes30 Sep 2024
- 2024RingMo-Aerial: An Aerial Remote Sensing Foundation Model With Affine Transformation Contrastive Learning20 Sep 2024
- 2024SCLNet: A Scale-Robust Complementary Learning Network for Object Detection in UAV Images11 Sep 2024
- 2024UDHF2-Net: Uncertainty-diffusion-model-based High-Frequency TransFormer Network for Remotely Sensed Imagery Interpretation23 Jun 2024
- 2024Twin Deformable Point Convolutions for Point Cloud Semantic Segmentation in Remote Sensing Scenes30 May 2024
- 2024SDL-MVS: View Space and Depth Deformable Learning Paradigm for Multi-View Stereo Reconstruction in Remote Sensing27 May 2024