mlsanityData to 7 Oct 2026

ConFusion: Continuous Fusion Space Learning for Fine-Grained Controllable Infrared and Visible Image Fusion

arXiv 2607.23600 ↗First posted 26 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Controllable infrared-visible image fusion aims to integrate complementary thermal and structural information with flexible region-aware modulation, producing fused images that adapt to diverse user requirements and downstream tasks. However, existing methods typically rely on predefined discrete control conditions, leading to a sparse space that fails to support fine-grained modulation demands. To address this, we propose ConFusion, a novel framework that learns the continuous fusion space via Gaussian-conditioned spatial-aware modulation, enabling instance-level fine-grained controllable infrared and visible image fusion. ConFusion employs a dual-branch architecture to disentangle modality-invariant and modality-specific representations under joint reconstruction and text-guided semantic alignment. Gaussian-conditioned instance modulation variables coupled with Grounded SAM-based instance masks guide instance-level fine-grained modulation through the Mask-Guided Specific Feature Modulator, while the Text-Driven Invariant Feature Enhancer improves semantic consistency and enhances fusion. During inference, the multimodal large language model parses user intents into instance-level modulation variables to guide image fusion. Extensive experiments show that ConFusion achieves state-of-the-art performance across multiple metrics in both fusion quality and downstream tasks, while supporting fine-grained controllable image fusion. Our code is available at https://github.com/HeyufeiAnto/Confusion

Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 26 Jul 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025SGDFuse: SAM-Guided Diffusion Model for High-Fidelity Infrared and Visible Image Fusion
  2. 2025Towards Unified Semantic and Controllable Image Fusion: A Diffusion Transformer Approach
  3. 2025Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Laws
  4. 2026DIFF-MF: A Difference-Driven Channel-Spatial State Space Model for Multi-Modal Image Fusion
  5. 2026Bringing Multimodal Large Language Models to Infrared-Visible Image Fusion Quality Assessment
  6. 2026MagicFuse: Single Image Fusion for Visual and Semantic Reinforcement
  7. 2025Dual-Domain Perspective on Degradation-Aware Fusion: A VLM-Guided Robust Infrared and Visible Image Fusion Framework
  8. 2026Adding Thermal Awareness to Visual Systems in Real-Time via Distilled Diffusion Models