Object Detection in Aerial Images: A Large-Scale Benchmark and Challenges
Not on the map. Why?
Abstract (arXiv)
In the past decade, object detection has achieved significant progress in natural images but not in aerial images, due to the massive variations in the scale and orientation of objects caused by the bird's-eye view of aerial images. More importantly, the lack of large-scale benchmarks has become a major obstacle to the development of object detection in aerial images (ODAI). In this paper,we present a large-scale Dataset of Object deTection in Aerial images (DOTA) and comprehensive baselines for ODAI. The proposed DOTA dataset contains 1,793,658 object instances of 18 categories of oriented-bounding-box annotations collected from 11,268 aerial images. Based on this large-scale and well-annotated dataset, we build baselines covering 10 state-of-the-art algorithms with over 70 configurations, where the speed and accuracy performances of each model have been evaluated. Furthermore, we provide a code library for ODAI and build a website for evaluating different algorithms. Previous challenges run on DOTA have attracted more than 1300 teams worldwide. We believe that the expanded large-scale DOTA dataset, the extensive baselines, the code library and the challenges can facilitate the designs of robust algorithms and reproducible research on the problem of object detection in aerial images.
Key facts. Cited by 202 papers in the map (data through 7 Oct 2026). Builds on 47 of its 88 references that are in the map. First posted on arXiv 24 Feb 2021.
Builds on
47 of 88 references.
References · 47
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2015Fast R-CNNcited by 2,930
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2017Deformable Convolutional Networkscited by 1,481
- 2016YOLO9000: Better, Faster, Strongercited by 1,429
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
35 more
- 2019Hybrid Task Cascade for Instance Segmentationcited by 479
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
- 2015WIDER FACE: A Face Detection Benchmarkcited by 297
- 2016Speed/accuracy trade-offs for modern convolutional object detectorscited by 198
- 2019iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Imagescited by 195
- 2020Align Deep Features for Oriented Object Detectioncited by 186
- 2017Arbitrary-Oriented Scene Text Detection via Rotation Proposalscited by 176
- 2017Drone-based Object Counting by Spatially Regularized Regional Proposal Networkcited by 155
- 2018xView: Objects in Context in Overhead Imagerycited by 145
- 2018Bounding Box Regression with Uncertainty for Accurate Object Detectioncited by 143
- 2019Gliding vertex on the horizontal bounding box for multi-oriented object detectioncited by 134
- 2017An Analysis of Scale Invariance in Object Detection - SNIPcited by 119
- 2018TextBoxes++: A Single-Shot Oriented Scene Text Detectorcited by 119
- 2019Towards Universal Object Detection by Domain Attentioncited by 89
- 2018Rotation-Sensitive Regression for Oriented Scene Text Detectioncited by 88
- 2016A Large Contextual Dataset for Classification, Detection and Counting of Cars with Deep Learningcited by 86
- 2019Clustered Object Detection in Aerial Imagescited by 83
- 2017Extreme clicking for efficient object annotationcited by 80
- 2018Vision Meets Drones: A Challengecited by 80
- 2020Dynamic Refinement Network for Oriented and Densely Packed Object Detectioncited by 72
- 2016Building a Large Scale Dataset for Image Emotion Recognition: The Fine Print and The Benchmarkcited by 71
- 2017Oriented Response Networkscited by 67
- 2020RarePlanes: Synthetic Data Takes Flightcited by 48
- 2018Towards Multi-class Object Detection in Unconstrained Remote Sensing Imagerycited by 46
- 2017Light-Head R-CNN: In Defense of Two-Stage Object Detectorcited by 30
- 2019SpaceNet MVOI: a Multi-View Overhead Imagery Datasetcited by 29
- 2020Solving Missing-Annotation Object Detection with Background Recalibration Losscited by 27
- 2018Soft Sampling for Robust Object Detectioncited by 22
- 2019Efficient Object Detection in Large Images using Deep Reinforcement Learningcited by 21
- 2018Real-Time Rotation-Invariant Face Detection with Progressive Calibration Networkscited by 15
- 2019Adaptive Period Embedding for Representing Oriented Objects in Aerial Imagescited by 14
- 2020FGSD: A Dataset for Fine-Grained Ship Detection in High Resolution Satellite Imagescited by 9
- 2018Vehicle Detection in Aerial Imagescited by 8
- 2019SimpleDet: A Simple and Versatile Distributed Framework for Object Detection and Instance Recognitioncited by 3
Built on by
Citing papers per year: 2021: 10; 2022: 30; 2023: 30; 2024: 47; 2025: 54; 2026: 31.
202 papers.
Sort:
By area:
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 181
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 119
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 116
- 2021Oriented RepPoints for Aerial Object Detectioncited by 102
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 101
- 2023The Segment Anything Model (SAM) for Remote Sensing Applications: From Zero to One Shotcited by 83
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 81
- 2022DynamicEarthNet: Daily Multi-Spectral Satellite Dataset for Semantic Change Segmentationcited by 78
- 2024HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Modelcited by 72
- 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
- 2023A Billion-scale Foundation Model for Remote Sensing Imagescited by 62
38 more
- 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 62
- 2022Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmarkcited by 56
- 2024Poly Kernel Inception Network for Remote Sensing Detectioncited by 52
- 2022RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detectioncited by 51
- 2023Dynamic Coarse-to-Fine Learning for Oriented Tiny Object Detectioncited by 43
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2023SAMRS: Scaling-up Remote Sensing Segmentation Dataset with Segment Anything Modelcited by 38
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruningcited by 35
- 20245%>100%: Breaking Performance Shackles of Full Fine-Tuning on Visual Recognition Taskscited by 34
- 2022Enabling Country-Scale Land Cover Mapping with Meter-Resolution Satellite Imagerycited by 31
- 2024STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagerycited by 31
- 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensingcited by 29
- 2024Visible-Thermal Tiny Object Detection: A Benchmark Dataset and Baselinescited by 27
- 2024Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentationcited by 26
- 2022Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Workscited by 24
- 2022Aerial Monocular 3D Object Detectioncited by 23
- 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trendscited by 23
- 2021A General Gaussian Heatmap Label Assignment for Arbitrary-Oriented Object Detectioncited by 22
- 2023HRVQA: A Visual Question Answering Benchmark for High-Resolution Aerial Imagescited by 21
- 2023Remote Sensing Object Detection Meets Deep Learning: A Meta-review of Challenges and Advancescited by 20
- 2023SOOD: Towards Semi-Supervised Oriented Object Detectioncited by 19
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2023Learning to Holistically Detect Bridges from Large-Size VHR Remote Sensing Imagerycited by 17
- 2023Multiview Aerial Visual Recognition (MAVREC): Can Multi-view Improve Aerial Visual Perception?cited by 17
- 2024Evaluating Tool-Augmented Agents in Remote Sensing Platformscited by 17
- 2023There Are No Data Like More Data- Datasets for Deep Learning in Earth Observationcited by 16
- 2024Video2BEV: Transforming Drone Videos to BEVs for Video-based Geo-localizationcited by 16
- 2025Small Object Detection: A Comprehensive Survey on Challenges, Techniques and Real-World Applicationscited by 16
- 2022Interactive Multi-Class Tiny-Object Detectioncited by 14
- 2022A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillancecited by 14
- 2024Popeye: A Unified Visual-Language Model for Multi-Source Ship Detection from Remote Sensing Imagerycited by 14
- 2024GRA: Detecting Oriented Objects through Group-wise Rotating and Attentioncited by 13
- 2024Size-invariance Matters: Rethinking Metrics and Losses for Imbalanced Multi-object Salient Object Detectioncited by 13
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 13
- 2022Learning to Extract Building Footprints from Off-Nadir Aerial Imagescited by 12
- 2024SOOD++: Leveraging Unlabeled Data to Boost Oriented Object Detectioncited by 12
- 2025ATRNet-STAR: A Large Dataset and Benchmark Towards Remote Sensing Object Recognition in the Wildcited by 12
- 2024OpenSatMap: A Fine-grained High-resolution Satellite Dataset for Large-scale Map Constructioncited by 11
50 most cited of 202 All 202 (JSON)
- 2026VesselBench-800K: A Large-scale Perception Benchmark for Multimodal Vessel Detection, Counting, and Density Estimation29 Sep 2026
- 2026Hi-OPD: Hierarchy-Aware Open-Prompt Detection for Remote Sensing Images22 Sep 2026
- 2026Understanding Dynamic Scenes at Gigapixel Scale: Wide-Area Spatio-Temporal Perception from UAVs16 Sep 2026
- 2026Guided Super-Resolution of Digital Elevation Models with Diffusion-Based Image Generators10 Sep 2026
- 2026EGM-Det: Entropy-Guided Multimodal Adaptive Fusion for UAV RGB-IR Object Detection12 Aug 2026
- 2026YOLOv14: Adaptive Real-Time Object Detection for Diverse Imaging Conditions5 Aug 2026
- 2026G-MAD: A Game-Based Data Generation Framework for Multi-View RGB-T Aerial Object Detection22 Jul 2026
- 2026LOGOS: Language-guided Oriented Object Detection in Aerial Scenes9 Jul 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026Diagnosing Aerial-View Object Detectors with Foundational Image Generative Models2 Jul 2026
- 2026Hierarchical Fine-Grained Aerial Object Detection15 Jun 2026
- 2026Learn Temporal Consistency For Robust Satellite Video Detector13 Jun 2026
38 more
- 2026BMCR: Adaptive Backbone Module Composition via Reinforcement Learning for Remote Sensing Object Detection4 Jun 2026
- 2026Count Anything29 May 2026
- 2026DefocusTrackerAI -- A Generalized Framework for the Automatic Detection of Defocused Particle Images22 May 2026
- 2026Beyond GSD-as-Token: Continuous Scale Conditioning for Remote Sensing VLMs8 May 2026
- 2026DenseScout: Algorithm-System Co-design for Budgeted Tiny Object Selection on Edge Platforms28 Apr 2026
- 2026UHR-DETR: Efficient End-to-End Small Object Detection for Ultra-High-Resolution Remote Sensing Imagery23 Apr 2026
- 2026Generalized Small Object Detection:A Point-Prompted Paradigm and Benchmark3 Apr 2026
- 2026Continual Vision-Language Learning for Remote Sensing: Benchmarking and Analysis1 Apr 2026
- 2026PKINet-v2: Towards Powerful and Efficient Poly-Kernel Remote Sensing Object Detection17 Mar 2026
- 2026PASTE: Physics-Aware Scattering Topology Embedding Framework for SAR Object Detection16 Mar 2026
- 2026RiO-DETR: DETR for Real-time Oriented Object Detection10 Mar 2026
- 2026VehAnchor: Metadata-Free Metric Scale Recovery from Vehicle Cues in Aerial Imagery4 Mar 2026
- 2026Meta-Learning Hyperparameters for Parameter Efficient Fine-Tuning2 Mar 2026
- 2026Fourier Angle Alignment for Oriented Object Detection in Remote Sensing27 Feb 2026
- 2026A High-Level Survey of Optical Remote Sensing19 Feb 2026
- 20261%>100%: High-Efficiency Visual Adapter with Complex Linear Projection Optimization11 Feb 2026
- 2026Adaptive Image Zoom-in with Bounding Box Transformation for UAV Object Detection7 Feb 2026
- 2026Do Open-Vocabulary Detectors Transfer to Aerial Imagery? A Comparative Evaluation13 Jan 2026
- 2026EarthVL: A Progressive Earth Vision-Language Understanding and Generation Framework6 Jan 2026
- 2025Forging Spatial Intelligence: A Roadmap of Multi-Modal Data Pre-Training for Autonomous Systems30 Dec 2025
- 2025GeoDiT: A Diffusion-based Vision-Language Model for Geospatial Understanding2 Dec 2025
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes27 Nov 2025
- 2025VK-Det: Visual Knowledge Guided Prototype Learning for Open-Vocabulary Aerial Object Detection22 Nov 2025
- 2025Object-aware graph matching network for cross-domain remote sensing image localization4 Nov 2025
- 2025Survey of Multimodal Geospatial Foundation Models: Techniques, Applications, and Challenges27 Oct 2025
- 2025Physics-Guided Fusion for Robust 3D Tracking of Fast Moving Small Objects23 Oct 2025
- 2025Enhancing Rotated Object Detection via Anisotropic Gaussian Bounding Box and Bhattacharyya Distance18 Oct 2025
- 2025Deep Learning Based Domain Adaptation Methods in Remote Sensing: A Comprehensive Survey17 Oct 2025
- 2025ExposureEngine: Oriented Logo Detection and Sponsor Visibility Analytics in Sports Broadcasts6 Oct 2025
- 2025Cross-View Open-Vocabulary Object Detection in Aerial Imagery4 Oct 2025
- 2025Referring Expression Comprehension for Small Objects4 Oct 2025
- 2025Mask Clustering-based Annotation Engine for Large-Scale Submeter Land Cover Mapping29 Sep 2025
- 2025VLCE: A Knowledge-Enhanced Framework for Image Description in Disaster Assessment25 Sep 2025
- 2025An Analysis of Kalman Filter based Object Tracking Methods for Fast-Moving Tiny Objects22 Sep 2025
- 2025Towards Size-invariant Salient Object Detection: A Generic Evaluation and Optimization Approach19 Sep 2025
- 2025A Novel Compression Framework for YOLOv8: Achieving Real-Time Aerial Object Detection on Edge Devices via Structured Pruning and Channel-Wise Distillation16 Sep 2025
- 2025S5: Scalable Semi-Supervised Semantic Segmentation in Remote Sensing17 Aug 2025
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysis4 Aug 2025
50 newest of 202 All 202 (JSON)
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 181
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 116
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 101
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 81
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruningcited by 35
- 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensingcited by 29
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2025GeoPix: Multi-Modal Large Language Model for Pixel-level Image Understanding in Remote Sensingcited by 10
- 2025VK-Det: Visual Knowledge Guided Prototype Learning for Open-Vocabulary Aerial Object Detectioncited by 1
- 2025GeoDiT: A Diffusion-based Vision-Language Model for Geospatial Understandingcited by 1
- 2026Beyond GSD-as-Token: Continuous Scale Conditioning for Remote Sensing VLMscited by 1
- 2025VLCE: A Knowledge-Enhanced Framework for Image Description in Disaster Assessmentcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Beyond GSD-as-Token: Continuous Scale Conditioning for Remote Sensing VLMs8 May 2026
- 2026Continual Vision-Language Learning for Remote Sensing: Benchmarking and Analysis1 Apr 2026
- 2026Do Open-Vocabulary Detectors Transfer to Aerial Imagery? A Comparative Evaluation13 Jan 2026
- 2025GeoDiT: A Diffusion-based Vision-Language Model for Geospatial Understanding2 Dec 2025
- 2025VK-Det: Visual Knowledge Guided Prototype Learning for Open-Vocabulary Aerial Object Detection22 Nov 2025
- 2025VLCE: A Knowledge-Enhanced Framework for Image Description in Disaster Assessment25 Sep 2025
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May 2025
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruning10 Mar 2025
- 2025GeoPix: Multi-Modal Large Language Model for Pixel-level Image Understanding in Remote Sensing12 Jan 2025
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec 2024
- 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensing18 Jul 2024
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun 2024
12 newest of 14 All 14 (JSON)
- 2024Evaluating Tool-Augmented Agents in Remote Sensing Platformscited by 17
- 2024Evaluating Tool-Augmented Agents in Remote Sensing Platforms23 Apr 2024
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 119
- 2021Oriented RepPoints for Aerial Object Detectioncited by 102
- 2023The Segment Anything Model (SAM) for Remote Sensing Applications: From Zero to One Shotcited by 83
- 2022DynamicEarthNet: Daily Multi-Spectral Satellite Dataset for Semantic Change Segmentationcited by 78
- 2024HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Modelcited by 72
- 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
- 2023A Billion-scale Foundation Model for Remote Sensing Imagescited by 62
- 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 62
- 2022Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmarkcited by 56
- 2024Poly Kernel Inception Network for Remote Sensing Detectioncited by 52
- 2022RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detectioncited by 51
12 most cited of 182 All 182 (JSON)
- 2026VesselBench-800K: A Large-scale Perception Benchmark for Multimodal Vessel Detection, Counting, and Density Estimation29 Sep 2026
- 2026Hi-OPD: Hierarchy-Aware Open-Prompt Detection for Remote Sensing Images22 Sep 2026
- 2026Understanding Dynamic Scenes at Gigapixel Scale: Wide-Area Spatio-Temporal Perception from UAVs16 Sep 2026
- 2026EGM-Det: Entropy-Guided Multimodal Adaptive Fusion for UAV RGB-IR Object Detection12 Aug 2026
- 2026YOLOv14: Adaptive Real-Time Object Detection for Diverse Imaging Conditions5 Aug 2026
- 2026G-MAD: A Game-Based Data Generation Framework for Multi-View RGB-T Aerial Object Detection22 Jul 2026
- 2026LOGOS: Language-guided Oriented Object Detection in Aerial Scenes9 Jul 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026Diagnosing Aerial-View Object Detectors with Foundational Image Generative Models2 Jul 2026
- 2026Hierarchical Fine-Grained Aerial Object Detection15 Jun 2026
- 2026Learn Temporal Consistency For Robust Satellite Video Detector13 Jun 2026
- 2026BMCR: Adaptive Backbone Module Composition via Reinforcement Learning for Remote Sensing Object Detection4 Jun 2026
12 newest of 182 All 182 (JSON)