Seeing Clearly without Training: Mitigating Hallucinations in Multimodal LLMs for Remote Sensing
On the map: Multimodal LLMs / vision-language models → Hallucination mitigation in LVLMs
Abstract (arXiv)
Multimodal large language models (MLLMs) suffer from pronounced hallucinations in remote sensing visual question-answering (RS-VQA), primarily caused by visual grounding failures in large-scale scenes or misinterpretation of fine-grained small targets. To systematically analyze these issues, we introduce RSHBench, a protocol-based benchmark for fine-grained diagnosis of factual and logical hallucinations. To mitigate grounding-induced factual hallucinations, we further propose Relative Attention-Driven Actively Reasoning (RADAR), a training-free inference method that leverages intrinsic attention in MLLMs to guide progressive localization and fine-grained local reasoning at test time. Extensive experiments across diverse MLLMs demonstrate that RADAR consistently improves RS-VQA performance and reduces both factual and logical hallucinations. Code and data will be publicly available at: https://github.com/MiliLab/RADAR
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Hallucination mitigation in LVLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 30 of its 38 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
30 of 38 references.
Closest ancestors · 6
Same direction, newest first
- 2024Investigating and Mitigating the Multimodal Hallucination Snowballing in Large Vision-Language Models30 Jun
- 2024A Survey on Hallucination in Large Vision-Language Models1 Feb
- 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding28 Nov
- 2023Analyzing and Mitigating Object Hallucination in Large Vision-Language Models1 Oct
- 2023Evaluation and Analysis of Hallucination in Large Vision-Language Models29 Aug
- 2023Detecting and Preventing Hallucinations in Large Vision Language Models11 Aug
Other references · 24
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Visual Instruction Tuningcited by 7,869
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2017SmoothGrad: removing noise by adding noisecited by 1,109
- 2020Quantifying Attention Flow in Transformerscited by 775
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
- 2023Instruction Tuning for Large Language Models: A Surveycited by 623
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
12 more
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 290
- 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 176
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 162
- 2023Large-scale Multi-Modal Pre-trained Models: A Comprehensive Surveycited by 153
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Modelcited by 138
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 121
- 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 83
- 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?cited by 51
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruningcited by 35
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Surveycited by 23
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 14
- 2025Look Where It Matters: Training-Free Ultra-HR Remote Sensing VQA via Adaptive Zoom Searchcited by 11
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026UHR-Micro: Diagnosing and Mitigating the Resolution Illusion in Earth Observation VLMscited by 1
- 2026GeoArbiter: Verifiability-Guided Grounding for Remote-Sensing Multimodal LLMscited by 0
- 2026The Earth in One Gaze: Training-Free Active Focus for UHR Remote Sensing Understandingcited by 0
- 2026Hallucination-aware Faithful Reasoning in Remote Sensingcited by 0
- 2026Hallucination-aware Faithful Reasoning in Remote Sensing13 Oct 2026
- 2026The Earth in One Gaze: Training-Free Active Focus for UHR Remote Sensing Understanding23 Sep 2026
- 2026GeoArbiter: Verifiability-Guided Grounding for Remote-Sensing Multimodal LLMs1 Aug 2026
- 2026UHR-Micro: Diagnosing and Mitigating the Resolution Illusion in Earth Observation VLMs12 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026RSHallu: Dual-Mode Hallucination Evaluation for Remote-Sensing Multimodal Large Language Models with Domain-Tailored Mitigation
- 2025Tracing and Mitigating Hallucinations in Multimodal LLMs via Dynamic Attention Localization
- 2025MIRAGE: Assessing Hallucination in Multimodal Reasoning Chains of MLLM
- 2025Mitigating Hallucinations in Vision-Language Models through Image-Guided Head Suppression
- 2025Seeing Far and Clearly: Mitigating Hallucinations in MLLMs with Attention Causal Decoding
- 2024Look, Compare, Decide: Alleviating Hallucination in Large Vision-Language Models via Multi-View Multi-Path Reasoning
- 2025Attention Reallocation: Towards Zero-cost and Controllable Hallucination Mitigation of MLLMs
- 2024Towards a Systematic Evaluation of Hallucinations in Large-Vision Language Models