DisDop: Distillation with Domain Priors for Open-Vocabulary Aerial Object Detection
Not on the map. Why?
Abstract (arXiv)
With the widespread application of drones in recent years, object detection of aerial images has attracted increasing attention, especially open-vocabulary aerial detection which is not restricted to predefined categories. Due to the scarcity of drone's viewpoint images and their significant differences from natural images, it is difficult to achieve satisfying results by directly applying vanilla open-vocabulary detection methods designed for natural scenarios. Some studies propose to transfer knowledge from pre-trained models by using lightweight networks or generating pseudo labels, but they tend to rely on models trained on natural images, neglecting the potential of foundation models specifically tailored for remote sensing and aerial imagery. To address this limitation, we propose DisDop, a unified framework that systematically distills multi-level domain priors from remote sensing foundation models (e.g., RemoteCLIP and DINOv3) into a lightweight detector. Specifically, we first distill visual priors through a teacher fusion strategy that combines RemoteCLIP's cross-modal alignment capability with DINOv3's fine-grained local feature extraction ability, transferring their complementary strengths to the detector's backbone. Second, we distill textual priors embedded in RemoteCLIP's text encoder by explicitly modeling inter-category semantic relationships, while incorporating global contextual priors to enhance local feature representation for small objects. Through this multi-level prior distillation framework, our DisDop achieves new state-of-the-art performance on open-vocabulary aerial detection benchmarks. Extensive ablation analysis also demonstrates the rationality and effectiveness of our proposed modules.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 37 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
34 of 37 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 612
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
22 more
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
- 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
- 2022Learning to Prompt for Open-Vocabulary Object Detection with Vision-Language Modelcited by 317
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
- 2022Open-Vocabulary DETR with Conditional Matchingcited by 220
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 202
- 2020Geography-Aware Self-Supervised Learningcited by 190
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 164
- 2022PromptDet: Towards Open-vocabulary Detection using Uncurated Imagescited by 133
- 2023CORA: Adapting CLIP for Open-Vocabulary Detection with Region Prompting and Anchor Pre-Matchingcited by 133
- 2019Clustered Object Detection in Aerial Imagescited by 83
- 2024MTP: Advancing Remote Sensing Foundation Model via Multi-Task Pretrainingcited by 66
- 2020Density Map Guided Object Detection in Aerial Imagescited by 56
- 2024Locate Anything on Earth: Advancing Open-Vocabulary Object Detection for Remote Sensing Communitycited by 50
- 2023Adaptive Sparse Convolutional Networks with Global Context Enhancement for Faster Object Detection on Drone Imagescited by 41
- 2023Global Knowledge Calibration for Fast Open-Vocabulary Segmentationcited by 40
- 2022TOV: The Original Vision Model for Optical Remote Sensing Image Understanding via Self-supervised Learningcited by 35
- 2021UFPMP-Det: Toward Accurate and Efficient Object Detection on Drone Imagerycited by 34
- 2020HRDNet: High-resolution Detection Network for Small Objectscited by 25
- 2023Toward Open Vocabulary Aerial Object Detection with CLIP-Activated Student-Teacher Learningcited by 22
Built on by
Not cited yet.