TCMA: Text-Conditioned Multi-granularity Alignment for Drone Cross-Modal Text-Video Retrieval
Not on the map. Why?
Abstract (arXiv)
Unmanned aerial vehicles (UAVs) have become powerful platforms for real-time, high-resolution data collection, producing massive volumes of aerial videos. Efficient retrieval of relevant content from these videos is crucial for applications in urban management, emergency response, security, and disaster relief. While text-video retrieval has advanced in natural video domains, the UAV domain remains underexplored due to limitations in existing datasets, such as coarse and redundant captions. Thus, in this work, we construct the Drone Video-Text Match Dataset (DVTMD), which contains 2,864 videos and 14,320 fine-grained, semantically diverse captions. The annotations capture multiple complementary aspects, including human actions, objects, background settings, environmental conditions, and visual style, thereby enhancing text-video correspondence and reducing redundancy. Building on this dataset, we propose the Text-Conditioned Multi-granularity Alignment (TCMA) framework, which integrates global video-sentence alignment, sentence-guided frame aggregation, and word-guided patch alignment. To further refine local alignment, we design a Word and Patch Selection module that filters irrelevant content, as well as a Text-Adaptive Dynamic Temperature Mechanism that adapts attention sharpness to text type. Extensive experiments on DVTMD and CapERA establish the first complete benchmark for drone text-video retrieval. Our TCMA achieves state-of-the-art performance, including 45.5% R@1 in text-to-video and 42.8% R@1 in video-to-text retrieval, demonstrating the effectiveness of our dataset and method. The code and dataset will be released.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 11 Oct 2025.
Builds on
27 of 43 references.
References · 27
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 645
- 2019End-to-End Learning of Visual Representations from Uncurated Instructional Videoscited by 506
- 2021Less is More: ClipBERT for Video-and-Language Learning via Sparse Samplingcited by 484
- 2022X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrievalcited by 127
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Modelcited by 112
15 more
- 2022TS2-Net: Token Shift and Selection Transformer for Text-Video Retrievalcited by 104
- 2022Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?cited by 90
- 2022Bridging Video-text Retrieval with Multiple Choice Questionscited by 79
- 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
- 2023UATVR: Uncertainty-Adaptive Text-Video Retrievalcited by 55
- 2023DiffusionRet: Generative Text-Video Retrieval with Diffusion Modelcited by 52
- 2023Unified Coarse-to-Fine Alignment for Video-Text Retrievalcited by 49
- 2025UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobilitycited by 48
- 2020ActionBert: Leveraging User Actions for Semantic Understanding of User Interfacescited by 43
- 2023UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modelingcited by 40
- 2024TempMe: Video Temporal Token Merging for Efficient Text-Video Retrievalcited by 39
- 2023Parameter-Efficient Transfer Learning for Remote Sensing Image-Text Retrievalcited by 24
- 2024A comprehensive survey of research towards AI-enabled unmanned aerial systems in pre-, active-, and post-wildfire managementcited by 23
- 2020ERA: A Dataset and Deep Learning Benchmark for Event Recognition in Aerial Videoscited by 17
- 2024Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learningcited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.