mlsanityData to 14 Oct 2026

Bringing Multimodal Large Language Models to Infrared-Visible Image Fusion Quality Assessment

arXiv 2605.06969 ↗First posted 7 May 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

Abstract (arXiv)

Infrared-Visible image fusion (IVIF) aims to integrate thermal information and detailed spatial structures into a single fused image to enhance perception. However, existing evaluation approaches tend to over-optimize both hand-crafted no-reference statistics and full-reference metrics that treat the source images as pseudo ground truths. Recent IVIF reward-modelling efforts learn from human ratings but use scalar regression on aggregated scores, neither leveraging the reasoning of Multimodal Large Language Models (MLLMs) nor encoding per-image perceptual ambiguity in their supervision, but naively introducing MLLMs with discrete one-hot supervision likewise collapses fused images of similar quality into different rating levels. To address this, we introduce FuScore, which utilizes an MLLM to mimic human visual perception by producing continuous quality score, rather than discrete level predictions, enabling fine-grained discrimination among fused images of similar quality. We exploit the agreement among four IVIF-specific sub-dimensions to construct a per-image soft label whose sharpness reflects how consensual the overall judgment is. We further introduce a tripartite objective combining per-image distributional supervision, within-source-pair Thurstone fidelity for method-level ordering, and cross-source-pair Thurstone fidelity for scene-level ordering across scenes. Extensive experiments demonstrate that FuScore achieves state-of-the-art correlation with human visual preferences.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 11 of its 30 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

11 of 30 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Qwen3-VL Technical Report26 Nov

Other references · 10

  1. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  2. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  3. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  4. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  5. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
  6. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
  7. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
  8. 2024DAE-Fuse: An Adaptive Discriminative Autoencoder for Multi-Modality Image Fusioncited by 5
  9. 2026Bridging Human Evaluation to Infrared and Visible Image Fusioncited by 4
  10. 2026EvaNet: Towards More Efficient and Consistent Infrared and Visible Image Fusion Assessmentcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  2. 2026DUALVISION: RGB-Infrared Multimodal Large Language Models for Robust Visual Reasoning
  3. 2025Demystifying the Visual Quality Paradox in Multimodal Large Language Models
  4. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Models
  5. 2024Infrared and Visible Image Fusion with Hierarchical Human Perception
  6. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models
  7. 2026ConFusion: Continuous Fusion Space Learning for Fine-Grained Controllable Infrared and Visible Image Fusion
  8. 2025IF-Bench: Benchmarking and Enhancing MLLMs for Infrared Images with Generative Visual Prompting