mlsanityData to 7 Oct 2026

GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensing

arXiv 2604.08896 ↗First posted 10 Apr 2026cs.CVcited by 6

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Recent advances in multimodal large language models (MLLMs) have accelerated progress in domain-oriented AI, yet their development in geoscience and remote sensing (RS) remains constrained by distinctive challenges: wide-ranging disciplinary knowledge, heterogeneous sensor modalities, and a fragmented spectrum of tasks. To bridge these gaps, we introduce GeoMMBench, a comprehensive multimodal question-answering benchmark covering diverse RS disciplines, sensors, and tasks, enabling broader and more rigorous evaluation than prior benchmarks. Using GeoMMBench, we assess 36 open-source and proprietary large language models, uncovering systematic deficiencies in domain knowledge, perceptual grounding, and reasoning--capabilities essential for expert-level geospatial interpretation. Beyond evaluation, we propose GeoMMAgent, a multi-agent framework that strategically integrates retrieval, perception, and reasoning through domain-specific RS models and tools. Extensive experimental results demonstrate that GeoMMAgent significantly outperforms standalone LLMs, underscoring the importance of tool-augmented agents for dynamically tackling complex geoscience and RS challenges.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 48 of its 56 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

48 of 56 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025SARLANG-1M: A Benchmark for Vision-Language Modeling in SAR Image Understanding4 Apr
  2. 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?31 Mar
  3. 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruning10 Mar
  4. 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
  5. 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks28 Nov
  6. 2024CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Models27 Nov
  7. 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
  8. 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun
  9. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
  10. 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
  11. 2024Good at captioning, bad at counting: Benchmarking GPT-4V on Earth observation data31 Jan
  12. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensing20 Dec
1 more
  1. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov

Other references · 35

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  5. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  6. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  7. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  8. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  9. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  10. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  11. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  12. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
23 more
  1. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  2. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
  3. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
  4. 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
  5. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  6. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  7. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 414
  8. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
  9. 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 259
  10. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
  11. 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
  12. 2023LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Modelscited by 217
  13. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
  14. 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
  15. 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 182
  16. 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 156
  17. 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
  18. 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 69
  19. 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 66
  20. 2018A Systematic Classification of Knowledge, Reasoning, and Context within the ARC Datasetcited by 54
  21. 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 51
  22. 2023Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matchingcited by 40
  23. 2024Mini-Monkey: Alleviating the Semantic Sawtooth Effect for Lightweight MLLMs via Complementary Image Pyramidcited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agents
  2. 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes
  3. 2026MapVerse: A Benchmark for Geospatial Question Answering on Diverse Real-World Maps
  4. 2024Evaluating Tool-Augmented Agents in Remote Sensing Platforms
  5. 2026GeoR-Bench: Evaluating Geoscience Visual Reasoning
  6. 2025ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Tasks
  7. 2025OmniGeo: Towards a Multimodal Large Language Models for Geospatial Artificial Intelligence
  8. 2024Geode: A Zero-shot Geospatial Question-Answering Agent with Explicit Reasoning and Precise Spatio-Temporal Retrieval