Open-Vocabulary Object Detection in UAV Imagery: A Review and Future Perspectives
Not on the map. Why?
Abstract (arXiv)
Due to its extensive applications, aerial image object detection has long been a hot topic in computer vision. In recent years, advancements in Unmanned Aerial Vehicles (UAV) technology have further propelled this field to new heights, giving rise to a broader range of application requirements. However, traditional UAV aerial object detection methods primarily focus on detecting predefined categories, which significantly limits their applicability. The advent of cross-modal text-image alignment (e.g., CLIP) has overcome this limitation, enabling open-vocabulary object detection (OVOD), which can identify previously unseen objects through natural language descriptions. This breakthrough significantly enhances the intelligence and autonomy of UAVs in aerial scene understanding. This paper presents a comprehensive survey of OVOD in the context of UAV aerial scenes. We begin by aligning the core principles of OVOD with the unique characteristics of UAV vision, setting the stage for a specialized discussion. Building on this foundation, we construct a systematic taxonomy that categorizes existing OVOD methods for aerial imagery and provides a comprehensive overview of the relevant datasets. This structured review enables us to critically dissect the key challenges and open problems at the intersection of these fields. Finally, based on this analysis, we outline promising future research directions and application prospects. This survey aims to provide a clear road map and a valuable reference for both newcomers and seasoned researchers, fostering innovation in this rapidly evolving domain. We keep tracing related works at https://github.com/zhouyang2002/OVOD-in-UVA-imagery
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 49 of its 91 references that are in the map. First posted on arXiv 4 Jul 2025.
Builds on
49 of 91 references.
References · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2015Fast R-CNNcited by 2,933
- 2018YOLOv3: An Incremental Improvementcited by 2,659
37 more
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2016YOLO9000: Better, Faster, Strongercited by 1,431
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 906
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 533
- 2020Open-Vocabulary Object Detection Using Captionscited by 427
- 2020Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detectioncited by 409
- 2021Open-Set Recognition: a Good Closed-Set Classifier is All You Need?cited by 353
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 340
- 2023LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 324
- 2022Learning to Prompt for Open-Vocabulary Object Detection with Vision-Language Modelcited by 317
- 2018Recent Advances in Open Set Recognition: A Surveycited by 310
- 2020Detection and Tracking Meet Drones Challengecited by 263
- 2018The Unmanned Aerial Vehicle Benchmark: Object Detection and Trackingcited by 208
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 204
- 2018Zero-Shot Object Detectioncited by 189
- 2018xView: Objects in Context in Overhead Imagerycited by 146
- 2022Bridging the Gap between Object and Image-level Representations for Open-Vocabulary Detectioncited by 146
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
- 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 123
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 122
- 2021Anchor-free Oriented Proposal Generator for Object Detectioncited by 105
- 2023Real-Time Flying Object Detection with YOLOv8cited by 94
- 2023V3Det: Vast Vocabulary Visual Detection Datasetcited by 81
- 2021A Normalized Gaussian Wasserstein Distance for Tiny Object Detectioncited by 53
- 2024Locate Anything on Earth: Advancing Open-Vocabulary Object Detection for Remote Sensing Communitycited by 50
- 2020Effective Fusion Factor in FPN for Tiny Object Detectioncited by 44
- 2024STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagerycited by 31
- 2023Toward Open Vocabulary Aerial Object Detection with CLIP-Activated Student-Teacher Learningcited by 22
- 2018Optimizing the Trade-off between Single-Stage and Two-Stage Object Detectors using Image Difficulty Predictioncited by 18
- 2023Learning to Holistically Detect Bridges from Large-Size VHR Remote Sensing Imagerycited by 17
- 2023How to Evaluate the Generalization of Detection? A Benchmark for Comprehensive Open-Vocabulary Detectioncited by 15
- 2024Zero-Shot Aerial Object Detection with Visual Description Regularizationcited by 10
- 2023What's in a Name? Beyond Class Indices for Image Recognitioncited by 9
- 2025OpenRSD: Towards Open-prompts for Object Detection in Remote Sensing Imagescited by 9
- 2025OS-W2S: An Automatic Labeling Engine for Language-Guided Open-Set Aerial Object Detectioncited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026DroneFINE: Domain-Aware Parameter-Efficient Fine-Tuning of Vision-Language Detectors for Drone Imagescited by 3
- 2026Open-Text Aerial Detection: A Unified Framework For Aerial Visual Grounding And Detectioncited by 2
- 2026Lightweight Multimodal Adaptation of Vision Language Models for Species Recognition and Habitat Context Interpretation in Drone Thermal Imagerycited by 0
- 2026DroneFINE: Domain-Aware Parameter-Efficient Fine-Tuning of Vision-Language Detectors for Drone Images1 Jul 2026
- 2026Lightweight Multimodal Adaptation of Vision Language Models for Species Recognition and Habitat Context Interpretation in Drone Thermal Imagery7 Apr 2026
- 2026Open-Text Aerial Detection: A Unified Framework For Aerial Visual Grounding And Detection8 Feb 2026