mlsanityData to 14 Oct 2026

Evaluating Remote Sensing Image Captions Beyond Metric Biases

arXiv 2604.22855 ↗First posted 22 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The core objective of image captioning is to achieve lossless semantic compression from visual signals into textual modalities. However, the reliance on manually curated reference texts for evaluation essentially forces models to mimic specific human annotation styles, thereby masking the true descriptive capabilities of advanced foundation models. This systemic misalignment prompts a critical question: Is task-specific fine-tuning truly necessary for Remote Sensing Image Captioning, or is the perceived performance gap merely an artifact of flawed evaluation criteria? To investigate this discrepancy, we propose ReconScore, a novel reference-free evaluation metric. Rather than computing textual similarities, we assess caption quality by its capability to reconstruct the original visual elements solely from the generated text, effectively neutralizing human annotation biases. Applying this metric, we uncover a profound, counterintuitive truth: inherently powerful, unfine-tuned MLLMs surpass their fine-tuned counterparts in authentic zero-shot RSIC tasks. Driven by this structural discovery, we introduce RemoteDescriber, a completely training-free generation methodology. By employing ReconScore as a self-correction mechanism, we iteratively refine the semantic precision of MLLM outputs without any computational fine-tuning overhead. Comprehensive experiments demonstrate that RemoteDescriber achieves state-of-the-art performance on three datasets. Furthermore, we validate ReconScore's reliability and analyze the flaws of traditional metrics. Our code is available at https://github.com/hhu-czy/RemoteDescriber.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 64 references that are in the map. First posted on arXiv 22 Apr 2026.

Builds on

28 of 64 references.

References · 28

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  4. 2016Variational Inference: A Review for Statisticianscited by 1,472
  5. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
  6. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  7. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 824
  8. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
  9. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
  10. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
  11. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 197
  12. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
16 more
  1. 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 138
  2. 2023A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captionscited by 108
  3. 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 104
  4. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 86
  5. 2024Benchmarking and Improving Detail Image Captioncited by 81
  6. 2023Positive-Augmented Contrastive Learning for Image and Video Captioning Evaluationcited by 78
  7. 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensingcited by 57
  8. 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Groundingcited by 47
  9. 2024FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Modelcited by 45
  10. 2025RemoteSAM: Towards Segment Anything for Earth Observationcited by 39
  11. 2021UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learningcited by 37
  12. 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensingcited by 29
  13. 2025SC-Captioner: Improving Image Captioning with Self-Correction by Reinforcement Learningcited by 16
  14. 2025FG-CLIP 2: A Bilingual Fine-grained Vision-Language Alignment Modelcited by 13
  15. 2025Patch Matters: Training-free Fine-grained Image Caption Enhancement via Local Perceptioncited by 12
  16. 2024What Makes for Good Image Captions?cited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Sentinel2Cap: A Human-Annotated Benchmark Dataset for Multimodal Remote Sensing Image Captioning
  2. 2025Beyond Pixels: A Training-Free, Text-to-Text Framework for Remote Sensing Image Retrieval
  3. 2025A Benchmark for Multi-Lingual Vision-Language Learning in Remote Sensing Image Captioning
  4. 2025Multilingual Training-Free Remote Sensing Image Captioning
  5. 2025Quality-Driven Curation of Remote Sensing Vision-Language Data via Learned Scoring Models
  6. 2025FarSLIP: Discovering Effective CLIP Adaptation for Fine-Grained Remote Sensing Understanding
  7. 2024LuoJiaHOG: A Hierarchy Oriented Geo-aware Image Caption Dataset for Remote Sensing Image-Text Retrival
  8. 2025A Recipe for Improving Remote Sensing VLM Zero Shot Generalization