mlsanityData to 7 Oct 2026

Datasets, Clues and State-of-the-Arts for Multimedia Forensics: An Extensive Review

arXiv 2401.06999 ↗First posted 13 Jan 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

With the large chunks of social media data being created daily and the parallel rise of realistic multimedia tampering methods, detecting and localising tampering in images and videos has become essential. This survey focusses on approaches for tampering detection in multimedia data using deep learning models. Specifically, it presents a detailed analysis of benchmark datasets for malicious manipulation detection that are publicly available. It also offers a comprehensive list of tampering clues and commonly used deep learning architectures. Next, it discusses the current state-of-the-art tampering detection methods, categorizing them into meaningful types such as deepfake detection methods, splice tampering detection methods, copy-move tampering detection methods, etc. and discussing their strengths and weaknesses. Top results achieved on benchmark datasets, comparison of deep learning approaches against traditional methods and critical insights from the recent tampering detection methods are also discussed. Lastly, the research gaps, future direction and conclusion are discussed to provide an in-depth understanding of the tampering detection research arena.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 45 of its 208 references that are in the map. First posted on arXiv 13 Jan 2024.

Builds on

45 of 208 references.

References · 45

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  3. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
  4. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 636
  5. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
  6. 2019Face X-ray for More General Face Forgery Detectioncited by 469
  7. 2019On the Detection of Digital Face Manipulationcited by 259
  8. 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 251
  9. 2020The Creation and Detection of Deepfakes: A Surveycited by 246
  10. 2021Coordinate Attention for Efficient Mobile Network Designcited by 239
  11. 2018Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videoscited by 180
  12. 2018Two-Stream Neural Networks for Tampered Face Detectioncited by 125
33 more
  1. 2018Noiseprint: a CNN-based camera model fingerprintcited by 114
  2. 2020Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cuescited by 111
  3. 2021Involution: Inverting the Inherence of Convolution for Visual Recognitioncited by 99
  4. 2020Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localizationcited by 89
  5. 2020DeepFake Detection by Analyzing Convolutional Tracescited by 81
  6. 2020Rotate to Attend: Convolutional Triplet Attention Modulecited by 75
  7. 2020DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythmscited by 65
  8. 2019Hybrid LSTM and Encoder-Decoder Architecture for Detection of Image Forgeriescited by 59
  9. 2020DeepFake Detection Based on the Discrepancy Between the Face and its Contextcited by 56
  10. 2021SA-Net: Shuffle Attention for Deep Convolutional Neural Networkscited by 54
  11. 2019GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detectioncited by 42
  12. 2020FakeLocator: Robust Localization of GAN-Based Face Manipulationscited by 40
  13. 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltalescited by 39
  14. 2020Deepfakes Detection with Automatic Face Weightingcited by 35
  15. 2021DefakeHop: A Light-Weight High-Performance Deepfake Detectorcited by 31
  16. 2019Forensic Similarity for Digital Imagescited by 27
  17. 2017Aligned and Non-Aligned Double JPEG Detection Using Convolutional Neural Networkscited by 22
  18. 2022Exposing Deepfake Face Forgeries with Guided Residualscited by 17
  19. 2017Localization of JPEG double compression through multi-domain convolutional neural networkscited by 15
  20. 2021Deepfake Forensics via An Adversarial Gamecited by 15
  21. 2020Attentive Semantic Exploring for Manipulated Face Detectioncited by 14
  22. 2017Detection and Localization of Image Forgeries using Resampling Features and Deep Learningcited by 13
  23. 2020Deep Convolutional Neural Network for Identifying Seam-Carving Forgerycited by 9
  24. 2019Extracting deep local features to detect manipulated images of human facescited by 8
  25. 2023TBFormer: Two-Branch Transformer for Image Forgery Localizationcited by 8
  26. 2020Detecting Face2Face Facial Reenactment in Videoscited by 7
  27. 2020Manipulation Detection in Satellite Images Using Deep Belief Networkscited by 7
  28. 2020Dynamic texture analysis for detecting fake faces in video sequencescited by 7
  29. 2019Deep Multi-scale Discriminative Networks for Double JPEG Compression Forensicscited by 6
  30. 2020Combining PRNU and noiseprint for robust and efficient device source identificationcited by 6
  31. 2018Boundary-based Image Forgery Detection by Fast Shallow CNNcited by 5
  32. 2020Temporal Sparse Adversarial Attack on Sequence-based Gait Recognitioncited by 5
  33. 2022Rethinking Gradient Operator for Exposing AI-enabled Face Forgeriescited by 5

Built on by

Not cited yet.