mlsanityData to 7 Oct 2026

Right Answer, Wrong Heat: Explanation-Aware Evaluation and Thermal-Grounded Feedback for MLLMs on Infrared Images

arXiv 2608.09145 ↗First posted 10 Aug 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

General-purpose multimodal large language models (MLLMs) are increasingly applied to infrared images, where they are commonly scored by answer accuracy alone. However, a correct answer does not ensure that the model's explanation is grounded in infrared thermal evidence. We introduce an explanation-aware evaluation framework that separates answer correctness, output-level explanation groundedness, and thermal grounding for infrared visual questions. Using a Dual-LLM Consensus Judge with a preliminary human-anchor calibration check, we find that correct answers can still rely on weak or visible-light evidence; withholding the original infrared image and showing only a visible-like rendering erodes thermal grounding with little accuracy change; and this erosion is observed most strongly for more capable models but disappears when infrared remains available. We further propose Thermal-Grounded Feedback (TGF), a training-free feedback loop that diagnoses explanation-side failures and revises the explanation while preserving the selected answer. On local paired-input validation, TGF improves explanation-side grounding without changing answers. These findings suggest that future trustworthy MLLMs for infrared scene understanding should be evaluated and developed to produce thermally grounded explanations rather than merely accurate answers.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 8 of its 15 references that are in the map. First posted on arXiv 10 Aug 2026.

Builds on

8 of 15 references.

References · 8

  1. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  2. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
  3. 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 83
  4. 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
  5. 2023TextFusion: Unveiling the Power of Textual Semantics for Controllable Image Fusioncited by 26
  6. 2024Infrared and Visible Image Fusion with Language-Driven Loss in CLIP Embedding Spacecited by 9
  7. 2025IF-Bench: Benchmarking and Enhancing MLLMs for Infrared Images with Generative Visual Promptingcited by 6
  8. 2026EvaNet: Towards More Efficient and Consistent Infrared and Visible Image Fusion Assessmentcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Thermo-VL: Extending Vision-Language Models to Thermal Infrared Perception
  2. 2025RGB-Th-Bench: A Dense benchmark for Visual-Thermal Understanding of Vision Language Models
  3. 2026ThermEval: A Structured Benchmark for Evaluation of Vision-Language Models on Thermal Imagery
  4. 2026DUALVISION: RGB-Infrared Multimodal Large Language Models for Robust Visual Reasoning
  5. 2026TherA: Thermal-Aware Visual-Language Prompting for Controllable RGB-to-Thermal Infrared Translation
  6. 2024Exploring Response Uncertainty in MLLMs: An Empirical Evaluation under Misleading Scenarios
  7. 2026Composition, Not Conversation: VLMs Lose the Scene, Not the Thread
  8. 2026T-CLIP: Enabling Thermal Perception for Contrastive Language-Image Pretraining