mlsanityData to 7 Oct 2026

Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matching

arXiv 2311.12751 ↗First posted 21 Nov 2023cs.CV cs.MMcited by 40

Not on the map. Why?

Abstract (arXiv)

Navigating drones through natural language commands remains challenging due to the dearth of accessible multi-modal datasets and the stringent precision requirements for aligning visual and textual data. To address this pressing need, we introduce GeoText-1652, a new natural language-guided geo-localization benchmark. This dataset is systematically constructed through an interactive human-computer process leveraging Large Language Model (LLM) driven annotation techniques in conjunction with pre-trained vision models. GeoText-1652 extends the established University-1652 image dataset with spatial-aware text annotations, thereby establishing one-to-one correspondences between image, text, and bounding box elements. We further introduce a new optimization objective to leverage fine-grained spatial associations, called blending spatial matching, for region-level spatial relation matching. Extensive experiments reveal that our approach maintains a competitive recall rate comparing other prevailing cross-modality methods. This underscores the promising potential of our approach in elevating drone control and navigation through the seamless integration of natural language commands in real-world scenarios.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 60 of its 86 references that are in the map. First posted on arXiv 21 Nov 2023.

Builds on

60 of 86 references.

References · 60

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  6. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  8. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  9. 2023A Survey of Large Language Modelscited by 2,537
  10. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
  11. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
  12. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
38 more
  1. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
  2. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
  3. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  4. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  5. 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 849
  6. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 300
  7. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
  8. 2022Language Models are Realistic Tabular Data Generatorscited by 290
  9. 2021An Empirical Study of Training End-to-End Vision-and-Language Transformerscited by 271
  10. 2020Detection and Tracking Meet Drones Challengecited by 261
  11. 2021Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Conceptscited by 255
  12. 2019Vision-and-Dialog Navigationcited by 246
  13. 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 230
  14. 2020Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-trainingcited by 228
  15. 2023Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Textcited by 208
  16. 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 192
  17. 2020VIGOR: Cross-View Image Geo-localization beyond One-to-one Retrievalcited by 188
  18. 2015Wide-Area Image Geolocalization with Aerial Reference Imagerycited by 185
  19. 2019Visual Semantic Reasoning for Image-Text Matchingcited by 185
  20. 2019Lending Orientation to Neural Networks for Cross-view Geo-localizationcited by 179
  21. 2019Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Taskscited by 177
  22. 2020Improving Vision-and-Language Navigation with Image-Text Pairs from the Webcited by 177
  23. 2022TransGeo: Transformer Is All You Need for Cross-view Image Geo-localizationcited by 166
  24. 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 152
  25. 2017Dual-Path Convolutional Image-Text Embeddings with Instance Losscited by 145
  26. 2019CAMP: Cross-Modal Adaptive Message Passing for Text-Image Retrievalcited by 110
  27. 2020Each Part Matters: Local Patterns Facilitate Cross-view Geo-localizationcited by 94
  28. 2022Cross-modal Map Learning for Vision and Language Navigationcited by 91
  29. 2022Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Imagecited by 88
  30. 2022Deep Visual Geo-localization Benchmarkcited by 83
  31. 2023LP-MusicCaps: LLM-Based Pseudo Music Captioningcited by 83
  32. 2023LLMaAA: Making Large Language Models as Active Annotatorscited by 78
  33. 2023Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioningcited by 77
  34. 2023Automated Annotation with Generative AI Requires Validationcited by 75
  35. 2023Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmarkcited by 75
  36. 2022Cross-view Geo-localization via Learning Disentangled Geometric Layout Correspondencecited by 69
  37. 2023Generative Recommendation: Towards Next-generation Recommender Paradigmcited by 69
  38. 2022A Transformer-Based Feature Segmentation and Region Alignment Method For UAV-View Geo-Localizationcited by 55

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 15; 2026: 22.

40 papers.

Sort:

By area:

  1. 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobilitycited by 48
  2. 2025How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspectivecited by 41
  3. 2025UAV-ON: A Benchmark for Open-World Object Goal Navigation with Aerial Agentscited by 31
  4. 2024MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuningcited by 22
  5. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
  6. 2024Video2BEV: Transforming Drone Videos to BEVs for Video-based Geo-localizationcited by 16
  7. 2024Weakly-supervised Camera Localization by Ground-to-satellite Image Registrationcited by 15
  8. 2026Foundation Models in Remote Sensing: Evolving from Unimodality to Multimodalitycited by 12
  9. 2025Next-Generation LLM for UAV: From Natural Language to Autonomous Flightcited by 10
  10. 2025Scale Up Composed Image Retrieval Learning via Modification Text Generationcited by 7
  11. 2025WeatherPrompt: Multi-modality Representation Learning for All-Weather Drone Visual Geo-Localizationcited by 7
  12. 2025CAMeL: Cross-modality Adaptive Meta-Learning for Text-based Person Retrievalcited by 6
28 more
  1. 2026GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensingcited by 6
  2. 2026APEX: A Decoupled Memory-based Explorer for Asynchronous Aerial Object Goal Navigationcited by 5
  3. 2026VLM-Loc: Localization in Point Cloud Maps via Vision-Language Modelscited by 4
  4. 2026UAVBench and UAVIT-1M: Benchmarking and Enhancing MLLMs for Low-Altitude UAV Vision-Language Understandingcited by 4
  5. 2026ESARBench: A Benchmark for Agentic UAV Embodied Search and Rescuecited by 4
  6. 2025EcoWikiRS: Learning Ecological Representation of Satellite Images from Weak Supervision with Species Observations and Wikipediacited by 3
  7. 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Taskscited by 3
  8. 2026Last-Meter Precision Navigation for UAVs: A Diffusion-Refined Aerial Visual Servoing Approachcited by 3
  9. 2025HCCM: Hierarchical Cross-Granularity Contrastive and Matching Learning for Natural Language-Guided Dronescited by 2
  10. 2025DiffusionUavLoc: Visually Prompted Diffusion for Cross-View UAV Localizationcited by 2
  11. 2025VisionDirector: Vision-Language Guided Closed-Loop Refinement for Generative Image Synthesiscited by 2
  12. 2026Global Cross-Modal Geo-Localization: A Million-Scale Dataset and a Physical Consistency Learning Frameworkcited by 1
  13. 2026Turning Generators into Retrievers: Unlocking MLLMs for Natural Language-Guided Geo-Localizationcited by 1
  14. 2026Agentic AI for Remote Sensing: Technical Challenges and Research Directionscited by 1
  15. 2026DialogueVPR: Towards Conversational Visual Place Recognitioncited by 1
  16. 2025TraveLLaMA: A Multimodal Travel Assistant with Large-Scale Dataset and Structured Reasoningcited by 0
  17. 2025Learning to Navigate Socially Through Proactive Risk Perceptioncited by 0
  18. 2025REMSA: Foundation Model Selection for Remote Sensing via a Constraint-Aware Agentcited by 0
  19. 2026TOL: Textual Localization with OpenStreetMapcited by 0
  20. 2026Road Maps as Free Geometric Priors: Weather-Invariant Drone Geo-Localization with GeoFusecited by 0
  21. 2026AgroVG: A Large-Scale Multi-Source Benchmark for Agricultural Visual Groundingcited by 0
  22. 2026MAPS: Multi-Anchor Projection Similarity for Joint Vision-Language Geo-Localizationcited by 0
  23. 2026AeroVerse-SatAgent: UAV-Satellite Collaborative Spatial Reasoning Inspired by the Dual Visual Pathway Theory of Cognitive Neurosciencecited by 0
  24. 2026Trajectory-aware Cross-view Geo-localization with Sequential Observationscited by 0
  25. 2026PACE: Polar Axis-Conditioned Estimation for PairUAV Relative Localizationcited by 0
  26. 2026ReLATE: Reliability-Guided Evidence Fusion for Robust UAV--Satellite cross-view Geo-Localizationcited by 0
  27. 2026UniGeo: A Multi-modal Large Language Model for Text-Guided Cross-View Geo-Localizationcited by 0
  28. 2026Multi-View Mixture-of-Experts with Vision-Language Reranking for Cross-View Object Geo-Localizationcited by 0