mlsanityData to 7 Oct 2026

Beyond Pixels: A Training-Free, Text-to-Text Framework for Remote Sensing Image Retrieval

arXiv 2512.10596 ↗First posted 11 Dec 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Semantic retrieval of remote sensing (RS) images is a critical task fundamentally challenged by the textquotesemantic gap, the discrepancy between a model's low-level visual features and high-level human concepts. While large Vision-Language Models (VLMs) offer a promising path to bridge this gap, existing methods often rely on costly, domain-specific training, and there is a lack of benchmarks to evaluate the practical utility of VLM-generated text in a zero-shot retrieval context. To address this research gap, we introduce the Remote Sensing Rich Text (RSRT) dataset, a new benchmark featuring multiple structured captions per image. Based on this dataset, we propose a fully training-free, text-only retrieval reference called TRSLLaVA. Our methodology reformulates cross-modal retrieval as a text-to-text (T2T) matching problem, leveraging rich text descriptions as queries against a database of VLM-generated captions within a unified textual embedding space. This approach completely bypasses model training or fine-tuning. Experiments on the RSITMD and RSICD benchmarks show our training-free method is highly competitive with state-of-the-art supervised models. For instance, on RSITMD, our method achieves a mean Recall of 42.62%, nearly doubling the 23.86% of the standard zero-shot CLIP baseline and surpassing several top supervised models. This validates that high-quality semantic representation through structured text provides a powerful and cost-effective paradigm for remote sensing image retrieval.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 23 references that are in the map. First posted on arXiv 11 Dec 2025.

Builds on

10 of 23 references.

References · 10

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  4. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
  5. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 357
  6. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
  7. 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
  8. 2024Benchmarking and Improving Detail Image Captioncited by 81
  9. 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
  10. 2020Content-based Image Retrieval and the Semantic Gap in the Deep Learning Eracited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Knowledge-aware Text-Image Retrieval for Remote Sensing Images
  2. 2025Remote Sensing Retrieval-Augmented Generation: Bridging Remote Sensing Imagery and Comprehensive Knowledge with a Multi-Modal Dataset and Retrieval-Augmented Generation Model
  3. 2024Composed Image Retrieval for Remote Sensing
  4. 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
  5. 2025VLM2GeoVec: Toward Universal Multimodal Embeddings for Remote Sensing
  6. 2025A Recipe for Improving Remote Sensing VLM Zero Shot Generalization
  7. 2024PriorCLIP: Visual Prior Guided Vision-Language Model for Remote Sensing Image-Text Retrieval
  8. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensing