HCCM: Hierarchical Cross-Granularity Contrastive and Matching Learning for Natural Language-Guided Drones
Not on the map. Why?
Abstract (arXiv)
Natural Language-Guided Drones (NLGD) provide a novel paradigm for tasks such as target matching and navigation. However, the wide field of view and complex compositional semantics in drone scenarios pose challenges for vision-language understanding. Mainstream Vision-Language Models (VLMs) emphasize global alignment while lacking fine-grained semantics, and existing hierarchical methods depend on precise entity partitioning and strict containment, limiting effectiveness in dynamic environments. To address this, we propose the Hierarchical Cross-Granularity Contrastive and Matching learning (HCCM) framework with two components: (1) Region-Global Image-Text Contrastive Learning (RG-ITC), which avoids precise scene partitioning and captures hierarchical local-to-global semantics by contrasting local visual regions with global text and vice versa; (2) Region-Global Image-Text Matching (RG-ITM), which dispenses with rigid constraints and instead evaluates local semantic consistency within global cross-modal representations, enhancing compositional reasoning. Moreover, drone text descriptions are often incomplete or ambiguous, destabilizing alignment. HCCM introduces a Momentum Contrast and Distillation (MCD) mechanism to improve robustness. Experiments on GeoText-1652 show HCCM achieves state-of-the-art Recall@1 of 28.8% (image retrieval) and 14.7% (text retrieval). On the unseen ERA dataset, HCCM demonstrates strong zero-shot generalization with 39.93% mean recall (mR), outperforming fine-tuned baselines.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 48 references that are in the map. First posted on arXiv 29 Aug 2025.
Builds on
25 of 48 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
- 2017A Closer Look at Memorization in Deep Networkscited by 936
- 2021An Empirical Study of Training End-to-End Vision-and-Language Transformerscited by 271
- 2021Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Conceptscited by 255
- 2018Hyperbolic Entailment Cones for Learning Hierarchical Embeddingscited by 160
- 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 152
- 2021Probabilistic Embeddings for Cross-Modal Retrievalcited by 150
- 2015Order-Embeddings of Images and Languagecited by 112
13 more
- 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baselinecited by 90
- 2019Polysemous Visual-Semantic Embedding for Cross-Modal Retrievalcited by 83
- 2021Unsupervised Object-Level Representation Learning from Scene Imagescited by 72
- 2020Self-Supervised Visual Representation Learning from Hierarchical Groupingcited by 63
- 2020Compositional Generalization by Learning Analytical Expressionscited by 53
- 2019Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddingscited by 49
- 2022Remote Sensing Cross-Modal Text-Image Retrieval Based on Global and Local Informationcited by 40
- 2023Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matchingcited by 40
- 2022Multiple-environment Self-adaptive Network for Aerial-view Geo-localizationcited by 37
- 2017Hierarchical Embeddings for Hypernymy Detection and Directionalitycited by 19
- 2017Specialising Word Vectors for Lexical Entailmentcited by 18
- 2024UniLoc: Towards Universal Place Recognition Using Any Single Modalitycited by 10
- 2025Poison as Cure: Visual Noise for Mitigating Object Hallucinations in LVMscited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Can Vision-Language Models Think from the Sky? Unifying UAV Reasoning and Generation
- 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
- 2025Hierarchical Language Models for Semantic Navigation and Manipulation in an Aerial-Ground Robotic System
- 2025A Parameter-Efficient Mixture-of-Experts Framework for Cross-Modal Geo-Localization
- 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
- 2025Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoning
- 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigation
- 2025Team Xiaomi EV-AD VLA: Caption-Guided Retrieval System for Cross-Modal Drone Navigation -- Technical Report for IROS 2025 RoboSense Challenge Track 4