Fusion of Infrared and Visible Images based on Spatial-Channel Attentional Mechanism
Not on the map. Why?
Abstract (arXiv)
In the study, we present AMFusionNet, an innovative approach to infrared and visible image fusion (IVIF), harnessing the power of multiple kernel sizes and attention mechanisms. By assimilating thermal details from infrared images with texture features from visible sources, our method produces images enriched with comprehensive information. Distinct from prevailing deep learning methodologies, our model encompasses a fusion mechanism powered by multiple convolutional kernels, facilitating the robust capture of a wide feature spectrum. Notably, we incorporate parallel attention mechanisms to emphasize and retain pivotal target details in the resultant images. Moreover, the integration of the multi-scale structural similarity (MS-SSIM) loss function refines network training, optimizing the model for IVIF task. Experimental results demonstrate that our method outperforms state-of-the-art algorithms in terms of quality and quantity. The performance metrics on publicly available datasets also show significant improvement
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 87 references that are in the map. First posted on arXiv 25 Aug 2023.
Builds on
18 of 87 references.
References · 18
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2020Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentationcited by 299
- 2018DenseFuse: A Fusion Approach to Infrared and Visible Imagescited by 180
- 2022FreeSOLO: Learning to Segment Objects without Annotationscited by 102
- 2017DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairscited by 77
- 2020DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusioncited by 72
- 2020NestFuse: An Infrared and Visible Image Fusion Architecture based on Nest Connection and Spatial/Channel Attention Modelscited by 62
- 2023Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Modelscited by 56
- 2018MDLatLRR: A novel decomposition method for infrared and visible image fusioncited by 54
6 more
- 2018Infrared and Visible Image Fusion using a Deep Learning Frameworkcited by 33
- 2020VIFB: A Visible and Infrared Image Fusion Benchmarkcited by 25
- 2018Infrared and Visible Image Fusion with ResNet and zero-phase component analysiscited by 16
- 2021Learning Co-segmentation by Segment Swapping for Retrieval and Discoverycited by 15
- 2021UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusioncited by 4
- 2022D2-LRR: A Dual-Decomposed MDLatLRR Approach for Medical Image Fusioncited by 2
Built on by
Not cited yet.