mlsanityData to 14 Oct 2026

Multilingual Training-Free Remote Sensing Image Captioning

arXiv 2512.00887 ↗First posted 30 Nov 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Remote sensing image captioning has advanced rapidly through encoder--decoder models, although the reliance on large annotated datasets and the focus on English restricts global applicability. To address these limitations, we propose the first training-free multilingual approach, based on retrieval-augmented prompting. For a given aerial image, we employ a domain-adapted SigLIP2 encoder to retrieve related captions and few-shot examples from a datastore, which are then provided to a language model. We explore two variants: an image-blind setup, where a multilingual Large Language Model (LLM) generates the caption from textual prompts alone, and an image-aware setup, where a Vision--Language Model (VLM) jointly processes the prompt and the input image. To improve the coherence of the retrieved content, we introduce a graph-based re-ranking strategy using PageRank on a graph of images and captions. Experiments on four benchmark datasets across ten languages demonstrate that our approach is competitive with fully supervised English-only systems and generalizes to other languages. Results also highlight the importance of re-ranking with PageRank, yielding up to 35% improvements in performance metrics. Additionally, it was observed that while VLMs tend to generate visually grounded but lexically diverse captions, LLMs can achieve stronger BLEU and CIDEr scores. Lastly, directly generating captions in the target language consistently outperforms other translation-based strategies. Overall, our work delivers one of the first systematic evaluations of multilingual, training-free captioning for remote sensing imagery, advancing toward more inclusive and scalable multimodal Earth observation systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 30 Nov 2025.

Builds on

26 of 37 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  7. 2025Gemma 3 Technical Reportcited by 1,824
  8. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  9. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
  10. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  11. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
  12. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
14 more
  1. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
  2. 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 206
  3. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 197
  4. 2021ZeroCap: Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmeticcited by 150
  5. 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 138
  6. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Modelcited by 113
  7. 2024EuroLLM: Multilingual Language Models for Europecited by 106
  8. 2022SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentationcited by 82
  9. 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 70
  10. 2014PageRank beyond the Webcited by 51
  11. 2023Retrieval-augmented Image Captioningcited by 29
  12. 2023Bootstrapping Interactive Image-Text Alignment for Remote Sensing Image Captioningcited by 18
  13. 2023NICE: CVPR 2023 Challenge on Zero-shot Image Captioningcited by 9
  14. 2024Multilingual Vision-Language Pre-training for the Remote Sensing Domaincited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Benchmark for Multi-Lingual Vision-Language Learning in Remote Sensing Image Captioning
  2. 2026bi-modal textual prompt learning for vision-language models in remote sensing
  3. 2024RS-MoE: A Vision-Language Model with Mixture of Experts for Remote Sensing Image Captioning and Visual Question Answering
  4. 2025Enhancing Remote Sensing Vision-Language Models Through MLLM and LLM-Based High-Quality Image-Text Dataset Generation
  5. 2023Remote Sensing Vision-Language Foundation Models without Annotations via Ground Remote Alignment
  6. 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
  7. 2025Beyond Pixels: A Training-Free, Text-to-Text Framework for Remote Sensing Image Retrieval
  8. 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing