mlsanityData to 14 Oct 2026

Equivariant Multi-Modality Image Fusion

arXiv 2305.11443 ↗First posted 19 May 2023cs.CVcited by 99

Not on the map. Why?

Abstract (arXiv)

Multi-modality image fusion is a technique that combines information from different sensors or modalities, enabling the fused image to retain complementary features from each modality, such as functional highlights and texture details. However, effective training of such fusion models is challenging due to the scarcity of ground truth fusion data. To tackle this issue, we propose the Equivariant Multi-Modality imAge fusion (EMMA) paradigm for end-to-end self-supervised learning. Our approach is rooted in the prior knowledge that natural imaging responses are equivariant to certain transformations. Consequently, we introduce a novel training paradigm that encompasses a fusion module, a pseudo-sensing module, and an equivariant fusion module. These components enable the net training to follow the principles of the natural sensing-imaging process while satisfying the equivariant imaging prior. Extensive experiments confirm that EMMA yields high-quality fusion results for infrared-visible and medical images, concurrently facilitating downstream multi-modal segmentation and detection tasks. The code is available at https://github.com/Zhaozixiang1228/MMIF-EMMA.

Key facts. Cited by 99 papers in the map (data through 14 Oct 2026). Builds on 28 of its 61 references that are in the map. First posted on arXiv 19 May 2023.

Builds on

28 of 61 references.

References · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  4. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
  5. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  6. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
  7. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
  8. 2018DenseFuse: A Fusion Approach to Infrared and Visible Imagescited by 180
  9. 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
  10. 2021RFN-Nest: An end-to-end residual fusion network for infrared and visible imagescited by 109
  11. 2023LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Imagescited by 87
  12. 2021Equivariant Imaging: Learning Beyond the Range Spacecited by 83
16 more
  1. 2021RigNet: Repetitive Image Guided Network for Depth Completioncited by 80
  2. 2022Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registrationcited by 80
  3. 2019Deep Convolutional Neural Network for Multi-modal Image Restoration and Fusioncited by 79
  4. 2020DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusioncited by 73
  5. 2021Discrete Cosine Transform Network for Guided Depth Map Super-Resolutioncited by 71
  6. 2022CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusioncited by 63
  7. 2021Robust Equivariant Imaging: a fully unsupervised framework for learning to image from noisy and partial measurementscited by 56
  8. 2018MDLatLRR: A novel decomposition method for infrared and visible image fusioncited by 54
  9. 2013Medical Image Fusion: A survey of the state of the artcited by 39
  10. 2022Imaging with Equivariant Deep Learningcited by 35
  11. 2022Sensing Theorems for Unsupervised Learning in Linear Inverse Problemscited by 28
  12. 2023Spherical Space Feature Decomposition for Guided Depth Map Super-Resolutioncited by 28
  13. 2022Deep Fourier Up-Samplingcited by 27
  14. 2021Image Fusion Transformercited by 24
  15. 2020Deep Convolutional Sparse Coding Networks for Image Fusioncited by 4
  16. 2023Single-photon Image Super-resolution via Self-supervised Learningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 16; 2025: 44; 2026: 37.

99 papers.

Sort:

By area:

  1. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
  2. 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 46
  3. 2025Every SAM Drop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyondcited by 35
  4. 2025DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusioncited by 34
  5. 2025One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusioncited by 32
  6. 2024Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion Modelcited by 31
  7. 2024Task-driven Image Fusion with Learnable Fusion Losscited by 25
  8. 2025Neural Video Compression with Context Modulationcited by 16
  9. 2023Scale-Equivariant Imaging: Self-Supervised Learning for Image Super-Resolution and Deblurringcited by 14
  10. 2024All-weather Multi-Modality Image Fusion: Unified Framework and 100k Benchmarkcited by 14
  11. 2025WaveMamba: Wavelet-Driven Mamba Fusion for RGB-Infrared Object Detectioncited by 14
  12. 2024TSJNet: A Multi-modality Target and Semantic Awareness Joint-driven Image Fusion Networkcited by 10
38 more
  1. 2024Dog-IQA: Standard-guided Zero-shot MLLM for Mix-grained Image Quality Assessmentcited by 9
  2. 2025ZeroFlow: Overcoming Catastrophic Forgetting is Easier than You Thinkcited by 9
  3. 2025MMAIF: Multi-task and Multi-degradation All-in-One for Image Fusion with Language Guidancecited by 9
  4. 2025ControlFusion: A Controllable Image Fusion Framework with Language-Vision Degradation Promptscited by 9
  5. 2025A Unified Solution to Video Fusion: From Multi-Frame Learning to Benchmarkingcited by 9
  6. 2025LUT-Fuse: Towards Extremely Fast Infrared and Visible Image Fusion via Distillation to Learnable Look-Up Tablescited by 9
  7. 2024S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusioncited by 8
  8. 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservationcited by 6
  9. 2025A Regularization-Guided Equivariant Approach for Image Restorationcited by 5
  10. 2025Rotation Equivariant Arbitrary-scale Image Super-Resolutioncited by 5
  11. 2025Task-Generalized Adaptive Cross-Domain Learning for Multimodal Image Fusioncited by 5
  12. 2025Spatial-Frequency Enhanced Mamba for Multi-Modal Image Fusioncited by 5
  13. 2023CHITNet: A Complementary to Harmonious Information Transfer Network for Infrared and Visible Image Fusioncited by 4
  14. 2024HDRT: A Large-Scale Dataset for Infrared-Guided HDR Imagingcited by 4
  15. 2025Residual Prior-driven Frequency-aware Network for Image Fusioncited by 4
  16. 2025FlexiD-Fuse: Flexible number of inputs multi-modal medical image fusion based on diffusion modelcited by 4
  17. 2026Bridging Human Evaluation to Infrared and Visible Image Fusioncited by 4
  18. 2025Retinex-MEF: Retinex-based Glare Effects Aware Unsupervised Multi-Exposure Image Fusioncited by 3
  19. 2025AWM-Fuse: Multi-Modality Image Fusion for Adverse Weather via Global and Local Text Perceptioncited by 3
  20. 2025Enhancing Infrared Vision: Progressive Prompt Fusion Network and Benchmarkcited by 3
  21. 2024l0-Regularized Sparse Coding-based Interpretable Network for Multi-Modal Image Fusioncited by 2
  22. 2025GrFormer: A Novel Transformer on Grassmann Manifold for Infrared and Visible Image Fusioncited by 2
  23. 2026EvaNet: Towards More Efficient and Consistent Infrared and Visible Image Fusion Assessmentcited by 2
  24. 2024IV-tuning: Parameter-Efficient Transfer Learning for Infrared-Visible Taskscited by 1
  25. 2025Dream-IF: Dynamic Relative EnhAnceMent for Image Fusioncited by 1
  26. 2025Bi-directional Self-Registration for Misaligned Infrared-Visible Image Fusioncited by 1
  27. 2025SMFusion: Semantic-Preserving Fusion of Multimodal Medical Images for Enhanced Clinical Diagnosiscited by 1
  28. 2025WIFE-Fusion:Wavelet-aware Intra-inter Frequency Enhancement for Multi-model Image Fusioncited by 1
  29. 2025Enhancing Synthetic CT from CBCT via Multimodal Fusion: A Study on the Impact of CBCT Quality and Alignmentcited by 1
  30. 2025UniFuse: A Unified All-in-One Framework for Multi-Modal Medical Image Fusion Under Diverse Degradations and Misalignmentscited by 1
  31. 2025Hierarchical Semantic-Visual Fusion of Visible and Near-infrared Images for Long-range Haze Removalcited by 1
  32. 2025AlignFreeNet: Is Cross-Modal Pre-Alignment Necessary? An End-to-End Alignment-Free Lightweight Network for Visible-Infrared Object Detectioncited by 1
  33. 2025Hyperbolic Cycle Alignment for Infrared-Visible Image Fusioncited by 1
  34. 2025MambaTrans: Multimodal Fusion Image Translation via Large Language Model Priors for Downstream Visual Taskscited by 1
  35. 2025VMDiff: Visual Mixing Diffusion for Limitless Cross-Object Synthesiscited by 1
  36. 2026Modality Dominance-Aware Optimization for Embodied RGB-Infrared Perceptioncited by 1
  37. 2026USFetal: Tools for Fetal Brain Ultrasound Compoundingcited by 1
  38. 2026SHARE: A Fully Unsupervised Framework for Single Hyperspectral Image Restorationcited by 1

50 most cited of 99 All 99 (JSON)