mlsanityData to 14 Oct 2026

P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation

arXiv 2608.13045 ↗First posted 13 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Infrared-visible image fusion (IVIF) is pivotal for multimodal perception, yet reconciling the inherent information disparity between thermal and textural features remains a fundamental challenge. Existing prior-guided methods often rely on static constraints that induce optimization conflicts or utilize extrinsic semantic priors from large-scale foundation models (e.g., CLIP/DINO), which frequently fail to exploit the intrinsic modality characteristics essential for high-fidelity fusion. To address these issues, we propose P2Fusion, a prior-guided distillation-based framework that reformulates IVIF via dual intrinsic prompts. Instead of imposing hard-coded penalties, we distill image-intrinsic priors, thermal saliency and spatial quality, into learnable dynamic regulators. Specifically, a Teach-to-Fuse mechanism provides dual-granularity progressive guidance, coupled with a Gated Dynamic Expert Recalibration (GDER) module for decoupled feature refinement. This design enables the network to adaptively mediate modal competition through expert specialization. Extensive experiments demonstrate that P2Fusion achieves state-of-the-art performance across five mainstream datasets. Notably, our framework demonstrates consistent performance advantages in fusion quality, achieving state-of-the-art results in 14 out of 20 key evaluation metrics across 5 benchmarks. Furthermore, it effectively contributes to the robustness of downstream perception, such as +3.2% mAP on MSRS, +0.5% mAP on M3FD and +0.9% mAP on DroneVehicle for object detection. Our code will be available at https://github.com/YiShi99/P2Fusion

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 65 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

25 of 65 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2023Segment Anythingcited by 8,234
  4. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  5. 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
  6. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
  7. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
  8. 2018DenseFuse: A Fusion Approach to Infrared and Visible Imagescited by 180
  9. 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
  10. 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 152
  11. 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 129
  12. 2021RFN-Nest: An end-to-end residual fusion network for infrared and visible imagescited by 109
13 more
  1. 2023Equivariant Multi-Modality Image Fusioncited by 99
  2. 2023LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Imagescited by 87
  3. 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 84
  4. 2022CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusioncited by 63
  5. 2023A Task-guided, Implicitly-searched and Meta-initialized Deep Model for Image Fusioncited by 47
  6. 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 46
  7. 2023Shape-Erased Feature Learning for Visible-Infrared Person Re-Identificationcited by 38
  8. 2025Every SAM Drop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyondcited by 35
  9. 2025DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusioncited by 34
  10. 2022TGFuse: An Infrared and Visible Image Fusion Approach Based on Transformer and Generative Adversarial Networkcited by 29
  11. 2020Context-Aware Graph Convolution Network for Target Re-identificationcited by 21
  12. 2025LUT-Fuse: Towards Extremely Fast Infrared and Visible Image Fusion via Distillation to Learnable Look-Up Tablescited by 9
  13. 2025Towards Unified Semantic and Controllable Image Fusion: A Diffusion Transformer Approachcited by 4

Built on by

Not cited yet.