mlsanityData to 7 Oct 2026

HCCM: Hierarchical Cross-Granularity Contrastive and Matching Learning for Natural Language-Guided Drones

arXiv 2508.21539 ↗First posted 29 Aug 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Natural Language-Guided Drones (NLGD) provide a novel paradigm for tasks such as target matching and navigation. However, the wide field of view and complex compositional semantics in drone scenarios pose challenges for vision-language understanding. Mainstream Vision-Language Models (VLMs) emphasize global alignment while lacking fine-grained semantics, and existing hierarchical methods depend on precise entity partitioning and strict containment, limiting effectiveness in dynamic environments. To address this, we propose the Hierarchical Cross-Granularity Contrastive and Matching learning (HCCM) framework with two components: (1) Region-Global Image-Text Contrastive Learning (RG-ITC), which avoids precise scene partitioning and captures hierarchical local-to-global semantics by contrasting local visual regions with global text and vice versa; (2) Region-Global Image-Text Matching (RG-ITM), which dispenses with rigid constraints and instead evaluates local semantic consistency within global cross-modal representations, enhancing compositional reasoning. Moreover, drone text descriptions are often incomplete or ambiguous, destabilizing alignment. HCCM introduces a Momentum Contrast and Distillation (MCD) mechanism to improve robustness. Experiments on GeoText-1652 show HCCM achieves state-of-the-art Recall@1 of 28.8% (image retrieval) and 14.7% (text retrieval). On the unseen ERA dataset, HCCM demonstrates strong zero-shot generalization with 39.93% mean recall (mR), outperforming fine-tuned baselines.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 48 references that are in the map. First posted on arXiv 29 Aug 2025.

Builds on

25 of 48 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  4. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
  5. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
  6. 2017A Closer Look at Memorization in Deep Networkscited by 936
  7. 2021An Empirical Study of Training End-to-End Vision-and-Language Transformerscited by 271
  8. 2021Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Conceptscited by 255
  9. 2018Hyperbolic Entailment Cones for Learning Hierarchical Embeddingscited by 160
  10. 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 152
  11. 2021Probabilistic Embeddings for Cross-Modal Retrievalcited by 150
  12. 2015Order-Embeddings of Images and Languagecited by 112
13 more
  1. 2022Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baselinecited by 90
  2. 2019Polysemous Visual-Semantic Embedding for Cross-Modal Retrievalcited by 83
  3. 2021Unsupervised Object-Level Representation Learning from Scene Imagescited by 72
  4. 2020Self-Supervised Visual Representation Learning from Hierarchical Groupingcited by 63
  5. 2020Compositional Generalization by Learning Analytical Expressionscited by 53
  6. 2019Inferring Concept Hierarchies from Text Corpora via Hyperbolic Embeddingscited by 49
  7. 2022Remote Sensing Cross-Modal Text-Image Retrieval Based on Global and Local Informationcited by 40
  8. 2023Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matchingcited by 40
  9. 2022Multiple-environment Self-adaptive Network for Aerial-view Geo-localizationcited by 37
  10. 2017Hierarchical Embeddings for Hypernymy Detection and Directionalitycited by 19
  11. 2017Specialising Word Vectors for Lexical Entailmentcited by 18
  12. 2024UniLoc: Towards Universal Place Recognition Using Any Single Modalitycited by 10
  13. 2025Poison as Cure: Visual Noise for Mitigating Object Hallucinations in LVMscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Can Vision-Language Models Think from the Sky? Unifying UAV Reasoning and Generation
  2. 2025UAV-VLN: End-to-End Vision Language guided Navigation for UAVs
  3. 2025Hierarchical Language Models for Semantic Navigation and Manipulation in an Aerial-Ground Robotic System
  4. 2025A Parameter-Efficient Mixture-of-Experts Framework for Cross-Modal Geo-Localization
  5. 2026Vision-Language Navigation for Aerial Robots: Towards the Era of Large Language Models
  6. 2025Aerial Vision-Language Navigation with a Unified Framework for Spatial, Temporal and Embodied Reasoning
  7. 2024Exploring Spatial Representation to Enhance LLM Reasoning in Aerial Vision-Language Navigation
  8. 2025Team Xiaomi EV-AD VLA: Caption-Guided Retrieval System for Cross-Modal Drone Navigation -- Technical Report for IROS 2025 RoboSense Challenge Track 4