FTPFusion: Frequency-Aware Infrared and Visible Video Fusion with Temporal Perturbation
Not on the map. Why?
Abstract (arXiv)
Infrared and visible video fusion plays a critical role in intelligent surveillance and low-light monitoring. However, maintaining temporal stability while preserving spatial detail remains a fundamental challenge. Existing methods either focus on frame-wise enhancement with limited temporal modeling or rely on heavy spatio-temporal aggregation that often sacrifices high-frequency details. In this paper, we propose FTPFusion, a frequency-aware infrared and visible video fusion method based on temporal perturbation and sparse cross-modal interaction. Specifically, FTPFusion decomposes the feature representations into high-frequency and low-frequency components for collaborative modeling. The high-frequency branch performs sparse cross-modal spatio-temporal interaction to capture motion-related context and complementary details. The low-frequency branch introduces a temporal perturbation strategy to enhance robustness against complex video variations, such as flickering, jitter, and local misalignment. Furthermore, we design an offset-aware temporal consistency constraint to explicitly stabilize cross-frame representations under temporal disturbances. Extensive experiments on multiple public benchmarks demonstrate that FTPFusion consistently outperforms state-of-the-art methods across multiple metrics in both spatial fidelity and temporal consistency. The source code will be available at https://github.com/ixilai/FTPFusion.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
18 of 36 references.
References · 18
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
- 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
- 2024SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video Segmentationcited by 43
- 2025Every SAM Drop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyondcited by 34
- 2025One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusioncited by 32
- 2024HDRFlow: Real-Time HDR Video Reconstruction with Large Motionscited by 30
- 2024All-weather Multi-Modality Image Fusion: Unified Framework and 100k Benchmarkcited by 14
- 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approachcited by 13
- 2023Bridging the Gap between Multi-focus and Multi-modal: A Focused Integration Framework for Multi-modal Image Fusioncited by 11
- 2024UMCFuse: A Unified Multiple Complex Scenes Infrared and Visible Image Fusion Frameworkcited by 9
6 more
- 2025A Unified Solution to Video Fusion: From Multi-Frame Learning to Benchmarkingcited by 8
- 2025VideoFusion: A Spatio-Temporal Collaborative Network for Multi-modal Video Fusioncited by 7
- 2025CrossFuse: Learning Infrared and Visible Image Fusion by Cross-Sensor Top-K Vision Alignment and Beyondcited by 5
- 2025TemCoCo: Temporally Consistent Multi-modal Video Fusion with Visual-Semantic Collaborationcited by 5
- 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservationcited by 5
- 2026MambaVF: State Space Model for Efficient Video Fusioncited by 1
Built on by
Not cited yet.