mlsanityData to 7 Oct 2026

Locate Anything on Earth: Advancing Open-Vocabulary Object Detection for Remote Sensing Community

arXiv 2408.09110 ↗First posted 17 Aug 2024cs.CVcited by 50

Not on the map. Why?

Abstract (arXiv)

Object detection, particularly open-vocabulary object detection, plays a crucial role in Earth sciences, such as environmental monitoring, natural disaster assessment, and land-use planning. However, existing open-vocabulary detectors, primarily trained on natural-world images, struggle to generalize to remote sensing images due to a significant data domain gap. Thus, this paper aims to advance the development of open-vocabulary object detection in remote sensing community. To achieve this, we first reformulate the task as Locate Anything on Earth (LAE) with the goal of detecting any novel concepts on Earth. We then developed the LAE-Label Engine which collects, auto-annotates, and unifies up to 10 remote sensing datasets creating the LAE-1M - the first large-scale remote sensing object detection dataset with broad category coverage. Using the LAE-1M, we further propose and train the novel LAE-DINO Model, the first open-vocabulary foundation object detector for the LAE task, featuring Dynamic Vocabulary Construction (DVC) and Visual-Guided Text Prompt Learning (VisGT) modules. DVC dynamically constructs vocabulary for each training batch, while VisGT maps visual features to semantic space, enhancing text features. We comprehensively conduct experiments on established remote sensing benchmark DIOR, DOTAv2.0, as well as our newly introduced 80-class LAE-80C benchmark. Results demonstrate the advantages of the LAE-1M dataset and the effectiveness of the LAE-DINO method.

Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). Builds on 43 of its 65 references that are in the map. First posted on arXiv 17 Aug 2024.

Builds on

43 of 65 references.

References · 43

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  7. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  9. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  10. 2016YOLO9000: Better, Faster, Strongercited by 1,429
  11. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  12. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
31 more
  1. 2020Meta-Learning in Neural Networks: A Surveycited by 944
  2. 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
  3. 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
  4. 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 612
  5. 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 569
  6. 2020Open-Vocabulary Object Detection Using Captionscited by 427
  7. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
  8. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
  9. 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
  10. 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
  11. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
  12. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
  13. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 202
  14. 2020Geography-Aware Self-Supervised Learningcited by 190
  15. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 164
  16. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
  17. 2018xView: Objects in Context in Overhead Imagerycited by 145
  18. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 123
  19. 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
  20. 2018LSTD: A Low-Shot Transfer Detector for Object Detectioncited by 77
  21. 2023Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignmentcited by 71
  22. 2023Aligning and Prompting Everything All at Once for Universal Visual Perceptioncited by 59
  23. 2023Multi-modal Queried Object Detection in the Wildcited by 47
  24. 2024Cross-Domain Few-Shot Object Detection via Enhanced Open-Set Object Detectorcited by 43
  25. 2023Segment Anything Model for Medical Images?cited by 39
  26. 2023Video-GroundingDINO: Towards Open-Vocabulary Spatio-Temporal Video Groundingcited by 32
  27. 2023Toward Open Vocabulary Aerial Object Detection with CLIP-Activated Student-Teacher Learningcited by 22
  28. 2018Transfer Learning in Multilingual Neural Machine Translation with Dynamic Vocabularycited by 18
  29. 2022Learning to Evaluate Performance of Multi-modal Semantic Localizationcited by 12
  30. 2017Neural Response Generation with Dynamic Vocabulariescited by 8
  31. 2022Self-paced Multi-grained Cross-modal Interaction Modeling for Referring Expression Comprehensioncited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 26; 2026: 23.

50 papers.

Sort:

By area:

  1. 2025NTIRE 2025 Challenge on Cross-Domain Few-Shot Object Detection: Methods and Resultscited by 25
  2. 2025Enhance Then Search: An Augmentation-Search Strategy with Foundation Models for Cross-Domain Few-Shot Object Detectioncited by 24
  3. 2025Geo-R1: Improving Few-Shot Geospatial Referring Expression Understanding with Reinforcement Fine-Tuningcited by 19
  4. 2025Domain-RAG: Retrieval-Guided Compositional Image Generation for Cross-Domain Few-Shot Object Detectioncited by 14
  5. 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agentscited by 13
  6. 2025EarthSynth: Generating Informative Earth Observation with Diffusion Modelscited by 12
  7. 2025V2-SAM: Marrying SAM2 with Multi-Prompt Experts for Cross-View Object Correspondencecited by 12
  8. 20253D-MOOD: Lifting 2D to 3D for Monocular Open-Set Object Detectioncited by 10
  9. 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenescited by 10
  10. 2025OpenRSD: Towards Open-prompts for Object Detection in Remote Sensing Imagescited by 9
  11. 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognitioncited by 8
  12. 2025RSVG-ZeroOV: Exploring a Training-Free Framework for Zero-Shot Open-Vocabulary Visual Grounding in Remote Sensing Imagescited by 8
38 more
  1. 2025Control Copy-Paste: Controllable Diffusion-Based Augmentation Method for Remote Sensing Few-Shot Object Detectioncited by 7
  2. 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensingcited by 6
  3. 2025Diverse Instance Generation via Diffusion Models for Enhanced Few-Shot Object Detection in Remote Sensing Imagescited by 5
  4. 2024Exploiting Unlabeled Data with Multiple Expert Teachers for Open Vocabulary Aerial Object Detection and Its Orientation Adaptationcited by 4
  5. 2025DPMambaIR: All-in-One Image Restoration via Degradation-Aware Prompt State Space Modelcited by 3
  6. 2025Open-Vocabulary Object Detection in UAV Imagery: A Review and Future Perspectivescited by 3
  7. 2025Survey of Multimodal Geospatial Foundation Models: Techniques, Applications, and Challengescited by 3
  8. 2026DroneFINE: Domain-Aware Parameter-Efficient Fine-Tuning of Vision-Language Detectors for Drone Imagescited by 3
  9. 2025OS-W2S: An Automatic Labeling Engine for Language-Guided Open-Set Aerial Object Detectioncited by 2
  10. 2025Semantic-Aware Ship Detection with Vision-Language Integrationcited by 2
  11. 2026Open-Text Aerial Detection: A Unified Framework For Aerial Visual Grounding And Detectioncited by 2
  12. 2026MemOVCD: Training-Free Open-Vocabulary Change Detection via Cross-Temporal Memory Reasoning and Global-Local Adaptive Rectificationcited by 2
  13. 2025Epistemic-aware Vision-Language Foundation Model for Fetal Ultrasound Interpretationcited by 1
  14. 2025ReefNet: A Large-Scale Dataset and Benchmark for Fine-Grained Coral Reef Recognitioncited by 1
  15. 2025FarSLIP: Discovering Effective CLIP Adaptation for Fine-Grained Remote Sensing Understandingcited by 1
  16. 2025VK-Det: Visual Knowledge Guided Prototype Learning for Open-Vocabulary Aerial Object Detectioncited by 1
  17. 2025Bridging the Scale Gap: Balanced Tiny and General Object Detection in Remote Sensing Imagerycited by 1
  18. 2026A Training-Free Guess What Vision Language Model from Snippets to Open-Vocabulary Object Detectioncited by 1
  19. 2026Beyond Open Vocabulary: Multimodal Prompting for Object Detection in Remote Sensing Imagescited by 1
  20. 2026RS-OVC: Open-Vocabulary Counting for Remote-Sensing Datacited by 1
  21. 2026Hi-OPD: Hierarchy-Aware Open-Prompt Detection for Remote Sensing Imagescited by 1
  22. 2025Light-Weight Cross-Modal Enhancement Method with Benchmark Construction for UAV-based Open-Vocabulary Object Detectioncited by 0
  23. 2025PMPGuard: Catching Pseudo-Matched Pairs in Remote Sensing Image-Text Retrievalcited by 0
  24. 2026LLM-VLM Fusion Framework for Autonomous Maritime Port Inspection using a Heterogeneous UAV-USV Systemcited by 0
  25. 2026Do Open-Vocabulary Detectors Transfer to Aerial Imagery? A Comparative Evaluationcited by 0
  26. 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysiscited by 0
  27. 2026Remote Sensing Image Dehazing: A Systematic Review of Progress, Challenges, and Prospectscited by 0
  28. 2026DisDop: Distillation with Domain Priors for Open-Vocabulary Aerial Object Detectioncited by 0
  29. 2026GiPL: Generative augmented iterative Pseudo-Labeling for Cross-Domain Few-Shot Object Detectioncited by 0
  30. 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videoscited by 0
  31. 2026GeoSelect: Spatial-Program Execution for Training-Free Referring Remote Sensing Image Segmentationcited by 0
  32. 2026OVEarth-Bench: Evaluating Category Breadth and Query Diversity for Open-Vocabulary Earth Observationcited by 0
  33. 2026RingMoClaw: An Experience-Inspired Multi-Agent Framework for Self-Evolving Research in Remote Sensingcited by 0
  34. 2026ProtoRAG: Prototype-Based Retrieval Augmentation for Few-Shot Fine-Grained Remote Sensing Object Detectioncited by 0
  35. 2026Hyperbolic Geometry for Open-World Object Detection in Remote Sensing Imagerycited by 0
  36. 2026Pro-Bench: Prompt-Robust Open-Vocabulary Visual Grounding Across Real-World Heterogeneous Environmentscited by 0
  37. 2026SetOPD: From Few Visual Exemplars to Multimodal Candidate Sets for Remote-Sensing Open-Prompt Detectioncited by 0
  38. 2026COBICount: Separating Object and Background Responses for Remote Sensing Object Counting Without Training on Target Datacited by 0