mlsanityData to 7 Oct 2026

Bridging Human Evaluation to Infrared and Visible Image Fusion

arXiv 2603.03871 ↗First posted 4 Mar 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Infrared and visible image fusion (IVIF) integrates complementary modalities to enhance scene perception. Current methods predominantly focus on optimizing handcrafted losses and objective metrics, often resulting in fusion outcomes that do not align with human visual preferences. This challenge is further exacerbated by the ill-posed nature of IVIF, which severely limits its effectiveness in human perceptual environments such as security surveillance and driver assistance systems. To address these limitations, we propose a feedback reinforcement framework that bridges human evaluation to infrared and visible image fusion. To address the lack of human-centric evaluation metrics and data, we introduce the first large-scale human feedback dataset for IVIF, containing multidimensional subjective scores and artifact annotations, and enriched by a fine-tuned large language model with expert review. Based on this dataset, we design a domain-specific reward function and train a reward model to quantify perceptual quality. Guided by this reward, we fine-tune the fusion network through Group Relative Policy Optimization, achieving state-of-the-art performance that better aligns fused images with human aesthetics. Code is available at https://github.com/ALKA-Wind/EVAFusion.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 70 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

36 of 70 references.

References · 36

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2023Segment Anythingcited by 8,158
  6. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  7. 2024GPT-4o System Cardcited by 4,467
  8. 2017Deep reinforcement learning from human preferencescited by 3,846
  9. 2023Qwen Technical Reportcited by 3,273
  10. 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
  11. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
  12. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
24 more
  1. 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
  2. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
  3. 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
  4. 2023Rich Human Feedback for Text-to-Image Generationcited by 139
  5. 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
  6. 2023Equivariant Multi-Modality Image Fusioncited by 98
  7. 2023LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Imagescited by 87
  8. 2023InstructVideo: Instructing Video Diffusion Models with Human Feedbackcited by 85
  9. 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 83
  10. 2022CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusioncited by 63
  11. 2023A Task-guided, Implicitly-searched and Meta-initialized Deep Model for Image Fusioncited by 47
  12. 2025DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusioncited by 34
  13. 2023Learning a Graph Neural Network with Cross Modality Interaction for Image Fusioncited by 28
  14. 2020VIFB: A Visible and Infrared Image Fusion Benchmarkcited by 25
  15. 2025DifIISR: A Diffusion Model with Gradient Guidance for Infrared Image Super-Resolutioncited by 21
  16. 2023From Text to Pixels: A Context-Aware Semantic Synergy Solution for Infrared and Visible Image Fusioncited by 19
  17. 2024MaeFuse: Transferring Omni Features with Pretrained Masked Autoencoders for Infrared and Visible Image Fusion via Guided Trainingcited by 15
  18. 2024AMFD: Distillation via Adaptive Multimodal Fusion for Multispectral Pedestrian Detectioncited by 15
  19. 2024Towards Reliable Advertising Image Generation Using Human Feedbackcited by 15
  20. 2025Integrating Extra Modality Helps Segmentor Find Camouflaged Objects Wellcited by 14
  21. 2025Efficient Rectified Flow for Image Fusioncited by 14
  22. 2024Conditional Controllable Image Fusioncited by 13
  23. 2023FusionBooster: A Unified Image Fusion Boosting Paradigmcited by 11
  24. 2024Instruction-Driven Fusion of Infrared-Visible Images: Tailoring for Diverse Downstream Taskscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Fusion in Your Way: Aligning Image Fusion with Heterogeneous Demands via Direct Preference Optimization
  2. 2024Infrared and Visible Image Fusion with Hierarchical Human Perception
  3. 2025Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Laws
  4. 2026MagicFuse: Single Image Fusion for Visual and Semantic Reinforcement
  5. 2025Guiding Perception-Reasoning Closer to Human in Blind Image Quality Assessment
  6. 2023Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Models
  7. 2025Dual-Domain Perspective on Degradation-Aware Fusion: A VLM-Guided Robust Infrared and Visible Image Fusion Framework
  8. 2025SGDFuse: SAM-Guided Diffusion Model for High-Fidelity Infrared and Visible Image Fusion