SenseBench: A Benchmark for Remote Sensing Low-Level Visual Perception and Description in Large Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Low-level visual perception underpins reliable remote sensing (RS) image analysis, yet current image quality assessment (IQA) methods output uninterpretable scalar scores rather than characterizing physics-driven RS degradations, deviating markedly from the diagnostic needs of RS experts. While Vision-Language Models (VLMs) present a compelling alternative by delivering language-grounded IQA, their visual priors are heavily biased toward ground-level natural images. Consequently, whether VLMs can overcome this domain gap to perceive and articulate RS artifacts remains insufficiently studied. To bridge this gap, we propose SenseBench, the first dedicated diagnostic benchmark for RS low-level visual perception and description. Driven by a physics-based hierarchical taxonomy that unifies both non-reference and reference-based paradigms, SenseBench features over 10K meticulously curated instances across 6 major and 22 fine-grained RS degradation categories. Specifically, two complementary protocols are designed for evaluation: objective low-level visual textitperception and subjective diagnostic textitdescription. Comprehensive evaluation of 29 state-of-the-art VLMs reveals not only skewed domain priors and multi-distortion collapse, but also textitfluency illusion and a textitperception-description inversion effect. We hope SenseBench provides a robust evaluation testbed and high-quality diagnostic data to advance the development of VLMs in RS low-level perception. Code and datasets are available hrefhttps://github.com/Zhong-Chenchen/SenseBenchtextcolorbluehere.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 48 of its 68 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
48 of 68 references.
Closest ancestors · 15
Same direction, newest first
- 2025SkyMoE: A Vision-Language Foundation Model for Enhancing Geospatial Interpretation with Mixture of Experts2 Dec
- 2025DisasterM3: A Remote Sensing Vision-Language Dataset for Disaster Damage Assessment and Response27 May
- 2025DynamicVL: Benchmarking Multimodal Large Language Models for Dynamic City Understanding27 May
- 2025REOBench: Benchmarking Robustness of Earth Observation Foundation Models22 May
- 2025Falcon: A Remote Sensing Vision-Language Foundation Model (Technical Report)14 Mar
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
- 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts7 Dec
- 2024CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Models27 Nov
- 2024LHRS-Bot-Nova: Improved Multimodal Large Language Model for Remote Sensing Vision-Language Interpretation14 Nov
- 2024RS-MoE: A Vision-Language Model with Mixture of Experts for Remote Sensing Image Captioning and Visual Question Answering3 Nov
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
3 more
Other references · 33
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024A Survey on LLM-as-a-Judgecited by 1,423
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,239
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
21 more
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2024Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Modelscited by 446
- 2025Kimi-VL Technical Reportcited by 388
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
- 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 280
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2024Ovis: Structural Embedding Alignment for Multimodal Large Language Modelcited by 169
- 2023Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Modelscited by 152
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 130
- 2025Ovis2.5 Technical Reportcited by 108
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 105
- 2024Towards Open-ended Visual Quality Comparisoncited by 85
- 2025Scaling Spatial Intelligence with Multimodal Foundation Modelscited by 82
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 70
- 2024Vision Foundation Models in Remote Sensing: A Surveycited by 54
- 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
- 2021Remote Sensing Image Super-resolution and Object Detection: Benchmark and State of the Artcited by 17
- 2024Jointly RS Image Deblurring and Super-Resolution with Adjustable-Kernel and Multi-Domain Attentioncited by 10
- 2025Revisiting MLLM Based Image Quality Assessment: Errors and Remedycited by 7
- 2026Task-Guided Prompting for Unified Remote Sensing Image Restorationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks
- 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
- 2025RS3DBench: A Comprehensive Benchmark for 3D Spatial Perception in Remote Sensing
- 2026Beyond Appearance: Can Multimodal Large Language Models Exploit Vertical Structure for Remote Sensing Natural Scene Understanding?
- 2026UHR-Micro: Diagnosing and Mitigating the Resolution Illusion in Earth Observation VLMs
- 2026A Controlled Benchmark of Visual State-Space Backbones with Domain-Shift and Boundary Analysis for Remote-Sensing Segmentation
- 2025Quality-Driven Curation of Remote Sensing Vision-Language Data via Learned Scoring Models
- 2025TDBench: A Benchmark for Top-Down Image Understanding with Reliability Analysis of Vision-Language Models