Progressive Domain Adaptation with Contrastive Learning for Object Detection in the Satellite Imagery
Not on the map. Why?
Abstract (arXiv)
State-of-the-art object detection methods applied to satellite and drone imagery largely fail to identify small and dense objects. One reason is the high variability of content in the overhead imagery due to the terrestrial region captured and the high variability of acquisition conditions. Another reason is that the number and size of objects in aerial imagery are very different than in the consumer data. In this work, we propose a small object detection pipeline that improves the feature extraction process by spatial pyramid pooling, cross-stage partial networks, heatmap-based region proposal network, and object localization and identification through a novel image difficulty score that adapts the overall focal loss measure based on the image difficulty. Next, we propose novel contrastive learning with progressive domain adaptation to produce domain-invariant features across aerial datasets using local and global components. We show we can alleviate the degradation of object identification in previously unseen datasets. We create a first-ever domain adaptation benchmark using contrastive learning for the object detection task in highly imbalanced satellite datasets with significant domain gaps and dominant small objects. The proposed method results in a 7.4% increase in mAP performance measure over the best state-of-art.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 63 references that are in the map. First posted on arXiv 6 Sep 2022.
Builds on
40 of 63 references.
References · 40
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2017Mask R-CNNcited by 7,259
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,323
28 more
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2019Objects as Pointscited by 1,172
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2020Hard Negative Mixing for Contrastive Learningcited by 399
- 2019CSPNet: A New Backbone that can Enhance Learning Capability of CNNcited by 381
- 2020Debiased Contrastive Learningcited by 354
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
- 2018Strong-Weak Distribution Alignment for Adaptive Object Detectioncited by 269
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
- 2017Central Moment Discrepancy (CMD) for Domain-Invariant Representation Learningcited by 192
- 2018Progressive Feature Alignment for Unsupervised Domain Adaptationcited by 183
- 2018xView: Objects in Context in Overhead Imagerycited by 145
- 2019Progressive Domain Adaptation for Object Detectioncited by 134
- 2021Probabilistic two-stage detectioncited by 130
- 2020Every Pixel Matters: Center-aware Feature Alignment for Domain Adaptive Object Detectorcited by 106
- 2021TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-captured Scenarioscited by 83
- 2018Vision Meets Drones: A Challengecited by 80
- 2016A Survey on Object Detection in Optical Remote Sensing Imagescited by 78
- 2021QueryDet: Cascaded Sparse Query for Accelerating High-Resolution Small Object Detectioncited by 70
- 2020Spatial Attention Pyramid Network for Unsupervised Domain Adaptationcited by 56
- 2020PP-YOLO: An Effective and Efficient Implementation of Object Detectorcited by 44
- 2020Small-Object Detection in Remote Sensing Images with End-to-End Edge-Enhanced GAN and Object Detector Networkcited by 35
- 2022Multi-Granularity Alignment Domain Adaptation for Object Detectioncited by 28
- 2021Rethinking InfoNCE: How Many Negative Samples Do You Need?cited by 18
- 2016Attentive Contexts for Object Detectioncited by 17
- 2021Remote Sensing Image Super-resolution and Object Detection: Benchmark and State of the Artcited by 17
- 2020Dynamic Traffic Modeling From Overhead Imagerycited by 8
Built on by
Not cited yet.