mlsanityData to 7 Oct 2026

VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding

arXiv 2406.12384 ↗First posted 18 Jun 2024cs.CVcited by 116

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

We introduce a new benchmark designed to advance the development of general-purpose, large-scale vision-language models for remote sensing images. Although several vision-language datasets in remote sensing have been proposed to pursue this goal, existing datasets are typically tailored to single tasks, lack detailed object information, or suffer from inadequate quality control. Exploring these improvement opportunities, we present a Versatile vision-language Benchmark for Remote Sensing image understanding, termed VRSBench. This benchmark comprises 29,614 images, with 29,614 human-verified detailed captions, 52,472 object references, and 123,221 question-answer pairs. It facilitates the training and evaluation of vision-language models across a broad spectrum of remote sensing image understanding tasks. We further evaluated state-of-the-art models on this benchmark for three vision-language tasks: image captioning, visual grounding, and visual question answering. Our work aims to significantly contribute to the development of advanced vision-language models in the field of remote sensing. The data and code can be accessed at https://github.com/lx709/VRSBench.

Key facts. Cited by 116 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 22 of its 56 references that are in the map. First posted on arXiv 18 Jun 2024.

Builds on

22 of 56 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
  2. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
  3. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
  4. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensing19 Jun
  5. 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trends9 May

Other references · 17

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  4. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  5. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  6. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  7. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 617
  8. 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 361
  9. 2024A Survey on Hallucination in Large Vision-Language Modelscited by 352
  10. 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
  11. 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
  12. 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 197
5 more
  1. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
  2. 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 121
  3. 2023Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentationcited by 76
  4. 2023RRSIS: Referring Remote Sensing Image Segmentationcited by 59
  5. 2022From Easy to Hard: Learning Language-guided Curriculum for Visual Question Answering on Remote Sensing Datacited by 38

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 12; 2025: 45; 2026: 59.

116 papers.

Sort:

By area:

  1. 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 81
  2. 2024MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMscited by 72
  3. 2024PANGAEA: A Global and Inclusive Benchmark for Geospatial Foundation Modelscited by 62
  4. 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Taskscited by 50
  5. 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?cited by 50
  6. 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Groundingcited by 46
  7. 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolutioncited by 41
  8. 2025DisasterM3: A Remote Sensing Vision-Language Dataset for Disaster Damage Assessment and Responsecited by 35
  9. 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Expertscited by 29
  10. 2024UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarioscited by 28
  11. 2024Cross-Modal Bidirectional Interaction Model for Referring Remote Sensing Image Segmentationcited by 26
  12. 2025Multimodal Referring Segmentation: A Surveycited by 22
38 more
  1. 2024CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Modelscited by 19
  2. 2025RingMo-Agent: A Unified Remote Sensing Foundation Model for Multi-Platform and Multi-Modal Reasoningcited by 19
  3. 2025Geo-R1: Improving Few-Shot Geospatial Referring Expression Understanding with Reinforcement Fine-Tuningcited by 19
  4. 2025Redundancy Principles for MLLMs Benchmarkscited by 18
  5. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
  6. 2025EarthMind: Leveraging Cross-Sensor Data for Advanced Earth Observation Interpretation with a Unified Multimodal LLMcited by 18
  7. 2025DynamicVL: Benchmarking Multimodal Large Language Models for Dynamic City Understandingcited by 17
  8. 2025RSRefSeg 2: Decoupling Referring Remote Sensing Image Segmentation with Foundation Modelscited by 17
  9. 2025RSVLM-QA: A Benchmark Dataset for Remote Sensing Vision Language Model-based Question Answeringcited by 17
  10. 2025SARLANG-1M: A Benchmark for Vision-Language Modeling in SAR Image Understandingcited by 16
  11. 2025OmniEarth-Bench: Towards Holistic Evaluation of Earth's Six Spheres and Cross-Spheres Interactions with Multimodal Observational Earth Datacited by 14
  12. 2025LISAT: Language-Instructed Segmentation Assistant for Satellite Imagerycited by 13
  13. 2025REOBench: Benchmarking Robustness of Earth Observation Foundation Modelscited by 13
  14. 2025RSCC: A Large-Scale Remote Sensing Change Caption Dataset for Disaster Eventscited by 13
  15. 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 13
  16. 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMscited by 11
  17. 2025GeoPix: Multi-Modal Large Language Model for Pixel-level Image Understanding in Remote Sensingcited by 10
  18. 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Imagescited by 10
  19. 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognitioncited by 8
  20. 2025Visual Instruction Pretraining for Domain-Specific Foundation Modelscited by 7
  21. 2026TerraScope: Pixel-Grounded Visual Reasoning for Earth Observationcited by 7
  22. 2024ImageRAG: Enhancing Ultra High Resolution Remote Sensing Imagery Analysis with ImageRAGcited by 6
  23. 2025DOFA-CLIP: Multimodal Vision-Language Foundation Models for Earth Observationcited by 6
  24. 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensingcited by 6
  25. 2025CoralVQA: A Large-Scale Visual Question Answering Dataset for Coral Reef Image Understandingcited by 6
  26. 2025Asking like Socrates: Socrates helps VLMs understand remote sensing imagescited by 6
  27. 2025SkyMoE: A Vision-Language Foundation Model for Enhancing Geospatial Interpretation with Mixture of Expertscited by 6
  28. 2026VLRS-Bench: A Vision-Language Reasoning Benchmark for Remote Sensingcited by 6
  29. 2026GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensingcited by 6
  30. 2025Landsat30-AU: A Vision-Language Dataset for Australian Landsat Imagerycited by 4
  31. 2025UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understandingcited by 4
  32. 2026DVGBench: Implicit-to-Explicit Visual Grounding Benchmark in UAV Imagery with Large Vision-Language Modelscited by 4
  33. 2024Towards Zero-Shot Annotation of the Built Environment with Vision-Language Models (Vision Paper)cited by 3
  34. 2025SPEX: A Vision-Language Model for Land Cover Extraction on Spectral Remote Sensing Imagescited by 3
  35. 2025Co-Training Vision Language Models for Remote Sensing Multi-task Learningcited by 3
  36. 2025GeoViS: Geospatially Rewarded Visual Search for Remote Sensing Visual Groundingcited by 3
  37. 2025FUSE-RSVLM: Feature Fusion Vision-Language Model for Remote Sensingcited by 3
  38. 2026Pix2Fact: When Vision Is Not Enough -- Benchmarking Fine-Grained VQA with Web Verification on High-Resolution Real-World Scenescited by 3

50 most cited of 116 All 116 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Pushing the Limits of Vision-Language Models in Remote Sensing without Human Annotations
  2. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
  3. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing
  4. 2025A Vision Centric Remote Sensing Benchmark
  5. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensing
  6. 2025Quality-Driven Curation of Remote Sensing Vision-Language Data via Learned Scoring Models
  7. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis
  8. 2024LHRS-Bot-Nova: Improved Multimodal Large Language Model for Remote Sensing Vision-Language Interpretation