mlsanityData to 7 Oct 2026

FTPFusion: Frequency-Aware Infrared and Visible Video Fusion with Temporal Perturbation

arXiv 2604.01900 ↗First posted 2 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Infrared and visible video fusion plays a critical role in intelligent surveillance and low-light monitoring. However, maintaining temporal stability while preserving spatial detail remains a fundamental challenge. Existing methods either focus on frame-wise enhancement with limited temporal modeling or rely on heavy spatio-temporal aggregation that often sacrifices high-frequency details. In this paper, we propose FTPFusion, a frequency-aware infrared and visible video fusion method based on temporal perturbation and sparse cross-modal interaction. Specifically, FTPFusion decomposes the feature representations into high-frequency and low-frequency components for collaborative modeling. The high-frequency branch performs sparse cross-modal spatio-temporal interaction to capture motion-related context and complementary details. The low-frequency branch introduces a temporal perturbation strategy to enhance robustness against complex video variations, such as flickering, jitter, and local misalignment. Furthermore, we design an offset-aware temporal consistency constraint to explicitly stabilize cross-frame representations under temporal disturbances. Extensive experiments on multiple public benchmarks demonstrate that FTPFusion consistently outperforms state-of-the-art methods across multiple metrics in both spatial fidelity and temporal consistency. The source code will be available at https://github.com/ixilai/FTPFusion.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

18 of 36 references.

References · 18

  1. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
  2. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
  3. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
  4. 2024Task-Customized Mixture of Adapters for General Image Fusioncited by 59
  5. 2024SAMWISE: Infusing Wisdom in SAM2 for Text-Driven Video Segmentationcited by 43
  6. 2025Every SAM Drop Counts: Embracing Semantic Priors for Multi-Modality Image Fusion and Beyondcited by 34
  7. 2025One Model for ALL: Low-Level Task Interaction Is a Key to Task-Agnostic Image Fusioncited by 32
  8. 2024HDRFlow: Real-Time HDR Video Reconstruction with Large Motionscited by 30
  9. 2024All-weather Multi-Modality Image Fusion: Unified Framework and 100k Benchmarkcited by 14
  10. 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approachcited by 13
  11. 2023Bridging the Gap between Multi-focus and Multi-modal: A Focused Integration Framework for Multi-modal Image Fusioncited by 11
  12. 2024UMCFuse: A Unified Multiple Complex Scenes Infrared and Visible Image Fusion Frameworkcited by 9
6 more
  1. 2025A Unified Solution to Video Fusion: From Multi-Frame Learning to Benchmarkingcited by 8
  2. 2025VideoFusion: A Spatio-Temporal Collaborative Network for Multi-modal Video Fusioncited by 7
  3. 2025CrossFuse: Learning Infrared and Visible Image Fusion by Cross-Sensor Top-K Vision Alignment and Beyondcited by 5
  4. 2025TemCoCo: Temporally Consistent Multi-modal Video Fusion with Visual-Semantic Collaborationcited by 5
  5. 2026UniFusion: A Unified Image Fusion Framework with Robust Representation and Source-Aware Preservationcited by 5
  6. 2026MambaVF: State Space Model for Efficient Video Fusioncited by 1

Built on by

Not cited yet.