mlsanityData to 7 Oct 2026

FMRFusion: Frequency-Aware Multi-View Representation Learning for Heterogeneous Image Fusion

arXiv 2606.07985 ↗First posted 6 Jun 2026cs.CV cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Infrared and visible image fusion aims to generate a composite image that retains significant target information and preserves detailed textures, integrating two heterogeneous modalities. Previous image fusion methods typically adopt a single-module stacking approach to extract features from the two modalities. However, these approaches may result in incomplete learning of their distinct characteristics, thereby limiting the fusion effectiveness and constrain ing robustness in real-world heterogeneous data scenarios. To address these challenges, we propose FMRFusion, a frequency-aware multi-view representation learning network for Heterogeneous Image Fusion. A Multi-Scale Struc tural Perception Module is introduced to effectively capture discriminative structures, extracting fine-grained local structures and essential contextual information. A bilinear frequency decomposition mechanism is employed to sepa rate features into high-frequency and low-frequency components, enabling joint modeling of local details and global representations across different frequency domains. Moreover, a Cross-View Complementary Interaction is incorpo rated to explicitly model and fuse the complementary characteristics between reflected light information and radiative intensity responses, facilitating effective cross-view interaction. We further improve the Performance of the fused results by flow matching, which progressively refines the fused features by learning the transformation from coarse data to high-quality representations. Extensive experiments conducted on multiple benchmark datasets demonstrate that FMRFusion achieves superior and consistent performance across a range of fusion tasks, especially in nighttime scenarios

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 66 references that are in the map. First posted on arXiv 6 Jun 2026.

Builds on

21 of 66 references.

References · 21

  1. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  2. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
  3. 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
  4. 2018DenseFuse: A Fusion Approach to Infrared and Visible Imagescited by 180
  5. 2021RFN-Nest: An end-to-end residual fusion network for infrared and visible imagescited by 109
  6. 2023LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Imagescited by 87
  7. 2019Deep Convolutional Neural Network for Multi-modal Image Restoration and Fusioncited by 78
  8. 2021KVT: k-NN Attention for Boosting Vision Transformerscited by 64
  9. 2020NestFuse: An Infrared and Visible Image Fusion Architecture based on Nest Connection and Spatial/Channel Attention Modelscited by 62
  10. 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 45
  11. 2024Image Fusion via Vision-Language Modelcited by 40
  12. 2021TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework using Self-Supervised Multi-Task Learningcited by 32
9 more
  1. 2023Bi-level Dynamic Learning for Jointly Multi-modality Image Fusion and Beyondcited by 26
  2. 2022SwinFuse: A Residual Swin Transformer Fusion Network for Infrared and Visible Imagescited by 25
  3. 2024Task-driven Image Fusion with Learnable Fusion Losscited by 24
  4. 2024TSJNet: A Multi-modality Target and Semantic Awareness Joint-driven Image Fusion Networkcited by 10
  5. 2019Learning Vertex Representations for Bipartite Networkscited by 9
  6. 2026Distilled Large Language Model-Driven Dynamic Sparse Expert Activation Mechanismcited by 7
  7. 2024DAE-Fuse: An Adaptive Discriminative Autoencoder for Multi-Modality Image Fusioncited by 4
  8. 2024ATFusion: An Alternate Cross-Attention Transformer Network for Infrared and Visible Image Fusioncited by 2
  9. 2025You Sense Only Once Beneath: Ultra-Light Real-Time Underwater Object Detectioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images
  2. 2025Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Laws
  3. 2023Multi-modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusion
  4. 2026ConFusion: Continuous Fusion Space Learning for Fine-Grained Controllable Infrared and Visible Image Fusion
  5. 2026Adding Thermal Awareness to Visual Systems in Real-Time via Distilled Diffusion Models
  6. 2026Fusion in Your Way: Aligning Image Fusion with Heterogeneous Demands via Direct Preference Optimization
  7. 2025SGDFuse: SAM-Guided Diffusion Model for High-Fidelity Infrared and Visible Image Fusion
  8. 2026DIFF-MF: A Difference-Driven Channel-Spatial State Space Model for Multi-Modal Image Fusion