mlsanityData to 7 Oct 2026

Current Injection Spiking Neural Network for Infrared and Visible Image Fusion

arXiv 2607.19879 ↗First posted 22 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Infrared and visible image fusion (IVIF) integrates the complementary information of two modalities into a single image with richer scene content. While existing methods are largely built on artificial neural networks (ANNs), which densely compute over all activations, spiking neural networks (SNNs) communicate through sparse binary spikes and compute only where and when a spike occurs, offering a route to more energy-efficient fusion. However, directly applying SNNs to IVIF creates a fundamental tension: cross-modal fusion relies on fine-grained responses from both modalities, whereas binary spikes can discard complementary cues that remain below the firing threshold. The membrane potential retains these subthreshold responses before firing, letting both modalities jointly shape the output when integrated at this stage. Building on this, we propose CIS-Fuse, a spiking network that performs cross-modal fusion directly at the membrane-potential level. At its core is the current injection spiking (CIS) operator, which injects one modality as a gated auxiliary current into the driving neuron of the other, so the two integrate before spike firing, with a per-channel learnable injection strength that adaptively regulates the modulation magnitude. Building on CIS, we construct a bidirectional cross-modal fusion (BCMF) module and deploy it on a dual-branch architecture with asymmetric stacking depths, where the two branches develop a clear functional specialization. Extensive experiments on four IVIF benchmarks and on downstream detection and segmentation show that CIS-Fuse achieves fusion quality on par with state-of-the-art ANN-based methods while inheriting the energy efficiency of spike-based computation, with roughly an order of magnitude lower inference energy than the similarly-sized ANN-based DCEvo. Code will be released upon publication.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 67 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

34 of 67 references.

References · 34

  1. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  2. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
  3. 2021RepVGG: Making VGG-style ConvNets Great Againcited by 520
  4. 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 340
  5. 2021Deep Residual Learning in Spiking Neural Networkscited by 326
  6. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
  7. 2020Going Deeper With Directly-Trained Larger Spiking Neural Networkscited by 268
  8. 2018Deep Learning in Spiking Neural Networkscited by 258
  9. 2018Direct Training for Spiking Neural Networks: Faster, Larger, Bettercited by 222
  10. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
  11. 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
  12. 2023Spike-driven Transformercited by 141
22 more
  1. 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
  2. 2021Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networkscited by 99
  3. 2023LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Imagescited by 87
  4. 2024Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusioncited by 83
  5. 2022Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registrationcited by 80
  6. 2024Integer-Valued Training and Spike-Driven Inference Spiking Neural Network for High-performance and Energy-efficient Object Detectioncited by 65
  7. 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
  8. 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 58
  9. 2023Dif-Fusion: Towards High Color Fidelity in Infrared and Visible Image Fusion with Diffusion Modelscited by 56
  10. 2023A Task-guided, Implicitly-searched and Meta-initialized Deep Model for Image Fusioncited by 47
  11. 2025Infrared and Visible Image Fusion: From Data Compatibility to Task Adaptioncited by 45
  12. 2024Image Fusion via Vision-Language Modelcited by 40
  13. 2024USTC-TD: A Test Dataset and Benchmark for Image and Video Coding in 2020scited by 37
  14. 2025DCEvo: Discriminative Cross-Dimensional Evolutionary Learning for Infrared and Visible Image Fusioncited by 34
  15. 2024Object Segmentation-Assisted Inter Prediction for Versatile Video Codingcited by 22
  16. 2024RLE: A Unified Perspective of Data Augmentation for Cross-Spectral Re-identificationcited by 15
  17. 2024Spiking Tucker Fusion Transformer for Audio-Visual Zero-Shot Learningcited by 10
  18. 2024S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusioncited by 8
  19. 2023SpikeCV: Open a Continuous Computer Vision Eracited by 7
  20. 2025Spiking Meets Attention: Efficient Remote Sensing Image Super-Resolution with Attention Spiking Neural Networkscited by 5
  21. 2025Spiking Variational Graph Representation Inference for Video Summarizationcited by 5
  22. 2025In-Loop Filtering Using Learned Look-Up Tables for Video Codingcited by 1

Built on by

Not cited yet.