FastForensics: Efficient Two-Stream Design for Real-Time Image Manipulation Detection
Not on the map. Why?
Abstract (arXiv)
With the rise in popularity of portable devices, the spread of falsified media on social platforms has become rampant. This necessitates the timely identification of authentic content. However, most advanced detection methods are computationally heavy, hindering their real-time application. In this paper, we describe an efficient two-stream architecture for real-time image manipulation detection. Our method consists of two-stream branches targeting the cognitive and inspective perspectives. In the cognitive branch, we propose efficient wavelet-guided Transformer blocks to capture the global manipulation traces related to frequency. This block contains an interactive wavelet-guided self-attention module that integrates wavelet transformation with efficient attention design, interacting with the knowledge from the inspective branch. The inspective branch consists of simple convolutions that capture fine-grained traces and interact bidirectionally with Transformer blocks to provide mutual support. Our method is lightweight (~ 8M) but achieves competitive performance compared to many other counterparts, demonstrating its efficacy in image manipulation detection and its potential for portable integration.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 29 Aug 2024.
Builds on
26 of 37 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2018Rethinking the Value of Network Pruningcited by 595
- 2020BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentationcited by 294
14 more
- 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 180
- 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
- 2018Learning Rich Features for Image Manipulation Detectioncited by 154
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
- 2021Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenescited by 89
- 2022PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllerscited by 84
- 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
- 2022Wave-ViT: Unifying Wavelet and Transformers for Visual Representation Learningcited by 78
- 2020Wavelet Integrated CNNs for Noise-Robust Image Classificationcited by 60
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
- 2023Pre-training-free Image Manipulation Localization through Non-Mutually Exclusive Contrastive Learningcited by 23
Built on by
Not cited yet.