ConFusion: Continuous Fusion Space Learning for Fine-Grained Controllable Infrared and Visible Image Fusion
Not on the map. Why?
Abstract (arXiv)
Controllable infrared-visible image fusion aims to integrate complementary thermal and structural information with flexible region-aware modulation, producing fused images that adapt to diverse user requirements and downstream tasks. However, existing methods typically rely on predefined discrete control conditions, leading to a sparse space that fails to support fine-grained modulation demands. To address this, we propose ConFusion, a novel framework that learns the continuous fusion space via Gaussian-conditioned spatial-aware modulation, enabling instance-level fine-grained controllable infrared and visible image fusion. ConFusion employs a dual-branch architecture to disentangle modality-invariant and modality-specific representations under joint reconstruction and text-guided semantic alignment. Gaussian-conditioned instance modulation variables coupled with Grounded SAM-based instance masks guide instance-level fine-grained modulation through the Mask-Guided Specific Feature Modulator, while the Text-Driven Invariant Feature Enhancer improves semantic consistency and enhances fusion. During inference, the multimodal large language model parses user intents into instance-level modulation variables to guide image fusion. Extensive experiments show that ConFusion achieves state-of-the-art performance across multiple metrics in both fusion quality and downstream tasks, while supporting fine-grained controllable image fusion. Our code is available at https://github.com/HeyufeiAnto/Confusion
Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 26 Jul 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SGDFuse: SAM-Guided Diffusion Model for High-Fidelity Infrared and Visible Image Fusion
- 2025Towards Unified Semantic and Controllable Image Fusion: A Diffusion Transformer Approach
- 2025Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Laws
- 2026DIFF-MF: A Difference-Driven Channel-Spatial State Space Model for Multi-Modal Image Fusion
- 2026Bringing Multimodal Large Language Models to Infrared-Visible Image Fusion Quality Assessment
- 2026MagicFuse: Single Image Fusion for Visual and Semantic Reinforcement
- 2025Dual-Domain Perspective on Degradation-Aware Fusion: A VLM-Guided Robust Infrared and Visible Image Fusion Framework
- 2026Adding Thermal Awareness to Visual Systems in Real-Time via Distilled Diffusion Models