RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images
Not on the map. Why?
Abstract (arXiv)
Infrared-visible image fusion facilitates robust multimodal perception by integrating complementary textural nuances from visible sensors with thermal signatures from infrared systems. Due to the task's inherently ill-posed nature, existing methods heavily rely on structural priors but typically enforce rotation equivariance uniformly across all features. Such a holistic approach overlooks a critical distinction where low-frequency shared structures strictly adhere to equivariant constraints while high-frequency modality-specific details require greater flexibility to preserve unique information. To bridge this gap, we propose RoES, a Rotational Equivariant Selective-frequency fusion network. Instead of employing static decomposition, we introduce a trainable rotation-enhanced updater/predictor module to dynamically decouple low- and high-frequency components. The resulting representations are then processed through a dual-branch fusion module tailored for spectral consistency. Specifically, a rotation-equivariant Mamba is employed to capture long-range structural dependencies in the low-frequency domain, while a polar spectral attention-based Dual-Fourier block refines high-frequency details under explicit low-frequency guidance. Extensive experiments demonstrate that RoES consistently achieves state-of-the-art performance in both fusion quality and downstream object detection, establishing a robust solution for multimodal fusion by reconciling frequency-selective features with equivariant constraints. The source code is available at https://github.com/BryceLosky/RoES-Fusion.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 63 references that are in the map. First posted on arXiv 11 Sep 2026.
Builds on
25 of 63 references.
References · 25
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2019General E(2)-Equivariant Steerable CNNscited by 446
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
- 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 295
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
- 2021ReDet: A Rotation-equivariant Detector for Aerial Object Detectioncited by 203
- 2017Learning Steerable Filters for Rotation Equivariant CNNscited by 194
- 2018DenseFuse: A Fusion Approach to Infrared and Visible Imagescited by 180
- 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 129
- 2021RFN-Nest: An end-to-end residual fusion network for infrared and visible imagescited by 109
- 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 84
13 more
- 2020DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusioncited by 73
- 2018MDLatLRR: A novel decomposition method for infrared and visible image fusioncited by 54
- 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 46
- 2023An Interactively Reinforced Paradigm for Joint Infrared-Visible Image Fusion and Saliency Object Detectioncited by 36
- 2025Every SAM Drop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyondcited by 35
- 2020PDO-eConvs: Partial Differential Operator Based Equivariant Convolutionscited by 34
- 2021Fourier Series Expansion Based Filter Parametrization for Equivariant Convolutionscited by 26
- 2023Learning Rotation-Equivariant Features for Visual Correspondencecited by 23
- 2024All-weather Multi-Modality Image Fusion: Unified Framework and 100k Benchmarkcited by 14
- 2024UMCFuse: A Unified Multiple Complex Scenes Infrared and Visible Image Fusion Frameworkcited by 9
- 2024Affine steerers for structured keypoint descriptioncited by 6
- 2025Rotation-Equivariant Self-Supervised Method in Image Denoisingcited by 6
- 2025A Regularization-Guided Equivariant Approach for Image Restorationcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FMRFusion: Frequency-Aware Multi-View Representation Learning for Heterogeneous Image Fusion
- 2025Dual-Domain Perspective on Degradation-Aware Fusion: A VLM-Guided Robust Infrared and Visible Image Fusion Framework
- 2026ConFusion: Continuous Fusion Space Learning for Fine-Grained Controllable Infrared and Visible Image Fusion
- 2026SpectraDINO: Modality-Conditioned Adaptation of RGB Vision Foundation Models Across Infrared Bands
- 2025Task-Generalized Adaptive Cross-Domain Learning for Multimodal Image Fusion
- 2026BeyondFusion: Self-Aligned Latent Diffusion for Calibration-Free Infrared Super-Resolution and Infrared-Visible Fusion
- 2025Revisiting Generative Infrared and Visible Image Fusion Based on Human Cognitive Laws
- 2026Bringing Multimodal Large Language Models to Infrared-Visible Image Fusion Quality Assessment