GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensing
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Recent advances in multimodal large language models (MLLMs) have accelerated progress in domain-oriented AI, yet their development in geoscience and remote sensing (RS) remains constrained by distinctive challenges: wide-ranging disciplinary knowledge, heterogeneous sensor modalities, and a fragmented spectrum of tasks. To bridge these gaps, we introduce GeoMMBench, a comprehensive multimodal question-answering benchmark covering diverse RS disciplines, sensors, and tasks, enabling broader and more rigorous evaluation than prior benchmarks. Using GeoMMBench, we assess 36 open-source and proprietary large language models, uncovering systematic deficiencies in domain knowledge, perceptual grounding, and reasoning--capabilities essential for expert-level geospatial interpretation. Beyond evaluation, we propose GeoMMAgent, a multi-agent framework that strategically integrates retrieval, perception, and reasoning through domain-specific RS models and tools. Extensive experimental results demonstrate that GeoMMAgent significantly outperforms standalone LLMs, underscoring the importance of tool-augmented agents for dynamically tackling complex geoscience and RS challenges.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 48 of its 56 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
48 of 56 references.
Closest ancestors · 13
Same direction, newest first
- 2025SARLANG-1M: A Benchmark for Vision-Language Modeling in SAR Image Understanding4 Apr
- 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?31 Mar
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruning10 Mar
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
- 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks28 Nov
- 2024CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Models27 Nov
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
- 2024Good at captioning, bad at counting: Benchmarking GPT-4V on Earth observation data31 Jan
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensing20 Dec
1 more
Other references · 35
- 2023GPT-4 Technical Reportcited by 18,132
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
23 more
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 414
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 344
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 259
- 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 257
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
- 2023LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Modelscited by 217
- 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
- 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
- 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLMcited by 182
- 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 156
- 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 69
- 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 66
- 2018A Systematic Classification of Knowledge, Reasoning, and Context within the ARC Datasetcited by 54
- 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 51
- 2023Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation Matchingcited by 40
- 2024Mini-Monkey: Alleviating the Semantic Sawtooth Effect for Lightweight MLLMs via Complementary Image Pyramidcited by 26
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Unison: Harmonizing Motion, Speech, and Sound for Human-Centric Audio-Video Generationcited by 6
- 2026TerraBench: Can Agents Reason Over Heterogeneous Earth-System Data?cited by 4
- 2026DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Groundingcited by 1
- 2026GeoDisaster: Benchmarking Orchestrated Agents for Operational Disaster Geo-Intelligencecited by 0
- 2026StreamTalk: Streaming Co-Speech Gesture Generation with Key-Pose Anchoringcited by 0
- 2026EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazardscited by 0
- 2026EarthVerse: Benchmarking Scientific Agents Across Dynamic Earth Systems and Natural Hazards24 Aug 2026
- 2026StreamTalk: Streaming Co-Speech Gesture Generation with Key-Pose Anchoring3 Aug 2026
- 2026DART: Difficulty-Adaptive Routing for Zero-Shot Video Temporal Grounding1 Jul 2026
- 2026GeoDisaster: Benchmarking Orchestrated Agents for Operational Disaster Geo-Intelligence15 Jun 2026
- 2026TerraBench: Can Agents Reason Over Heterogeneous Earth-System Data?11 Jun 2026
- 2026Unison: Harmonizing Motion, Speech, and Sound for Human-Centric Audio-Video Generation9 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agents
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes
- 2026MapVerse: A Benchmark for Geospatial Question Answering on Diverse Real-World Maps
- 2024Evaluating Tool-Augmented Agents in Remote Sensing Platforms
- 2026GeoR-Bench: Evaluating Geoscience Visual Reasoning
- 2025ThinkGeo: Evaluating Tool-Augmented Agents for Remote Sensing Tasks
- 2025OmniGeo: Towards a Multimodal Large Language Models for Geospatial Artificial Intelligence
- 2024Geode: A Zero-shot Geospatial Question-Answering Agent with Explicit Reasoning and Precise Spatio-Temporal Retrieval