Capsule-Forensics: Using Capsule Networks to Detect Forged Images and Videos
Not on the map. Why?
Abstract (arXiv)
Recent advances in media generation techniques have made it easier for attackers to create forged images and videos. State-of-the-art methods enable the real-time creation of a forged version of a single video obtained from a social network. Although numerous methods have been developed for detecting forged images and videos, they are generally targeted at certain domains and quickly become obsolete as new kinds of attacks appear. The method introduced in this paper uses a capsule network to detect various kinds of spoofs, from replay attacks using printed images or recorded videos to computer-generated videos using deep convolutional neural networks. It extends the application of capsule networks beyond their original intention to the solving of inverse graphics problems.
Key facts. Cited by 180 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 36; 2022: 26; 2023: 32; 2024: 31; 2025: 33; 2026: 22.
180 papers.
Sort:
By area:
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 126
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2023Art and the science of generative AI: A deeper divecited by 93
- 2021Spatiotemporal Inconsistency Learning for DeepFake Video Detectioncited by 88
- 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 88
- 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
38 more
- 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 68
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2021Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Featurescited by 57
- 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 57
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
- 2023Beyond the Prior Forgery Knowledge: Mining Critical Clues for General Face Forgery Detectioncited by 50
- 2024Can We Leave Deepfake Data Behind in Training Deepfake Detector?cited by 48
- 2022Voice-Face Homogeneity Tells Deepfakecited by 44
- 2021Efficient-CapsNet: Capsule Network with Self-Attention Routingcited by 41
- 2023Improving Fairness in Deepfake Detectioncited by 40
- 2021Video Transformer for Deepfake Detection with Incremental Learningcited by 33
- 2023UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localizationcited by 33
- 2024MoE-FFD: Mixture of Experts for Generalized and Parameter-Efficient Face Forgery Detectioncited by 27
- 2021COSMOS: Catching Out-of-Context Misinformation with Self-Supervised Learningcited by 26
- 2021TAFIM: Targeted Adversarial Attacks against Facial Image Manipulationscited by 25
- 2022Restricted Black-box Adversarial Attack Against DeepFake Face Swappingcited by 25
- 2022Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cuescited by 24
- 2025ForensicHub: A Unified Benchmark & Codebase for All-Domain Fake Image Detection and Localizationcited by 22
- 2023Controllable Guide-Space for Generalizable Face Forgery Detectioncited by 21
- 2021DeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learningcited by 20
- 2023Detect Any Deepfakes: Segment Anything Meets Face Forgery Detection and Localizationcited by 20
- 2021TAR: Generalized Forensic Framework to Detect Deepfakes using Weakly Supervised Learningcited by 19
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensicscited by 18
- 2021Conditional Variational Capsule Network for Open Set Recognitioncited by 17
- 2022Model Attribution of Face-swap Deepfake Videoscited by 17
- 2022Digital and Physical Face Attacks: Reviewing and One Step Furthercited by 17
- 2023Detecting Deepfakes Without Seeing Anycited by 17
- 2024GM-DF: Generalized Multi-Scenario Deepfake Detectioncited by 16
- 2021Detection and Localization of Facial Expression Manipulationscited by 15
- 2021Watch Those Words: Video Falsification Detection Using Word-Conditioned Facial Motioncited by 15
- 2023The Age of Synthetic Realities: Challenges and Opportunitiescited by 15
- 2024SoK: Systematization and Benchmarking of Deepfake Detectors in a Unified Frameworkcited by 14
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
- 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasingcited by 14
- 2023GenConViT: Deepfake Video Detection Using Generative Convolutional Vision Transformercited by 12
50 most cited of 180 All 180 (JSON)
- 2026Trustworthy synthetic visual media: Evidence across the media lifecycle28 Sep 2026
- 2026IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Models17 Sep 2026
- 2026Deep-Fake CAPTCHA: Mitigating Next-Generation Social Engineering Attacks10 Sep 2026
- 2026AdaForensics: Learning A Characteristic-aware Adaptive Deepfake Detector3 Aug 2026
- 2026Teacher-Student Structure for Domain Adaptation in Ensemble Audio-Visual Video Deepfake Detection13 Jun 2026
- 2026A Multi-Domain Feature Fusion Framework for Generalizable Deepfake Detection Across Different Generators12 Jun 2026
- 2026ClueAegis: Heuristic-to-Reasoning Cognitive-skill Learning for Unified Evidence-based Synthetic Image Detection24 May 2026
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localization13 May 2026
- 2026UniShield: Unified Face Attack Detection via KG-Informed Multimodal Reasoning9 May 2026
- 2026DYMAPIA: A Multi-Domain Framework for Detecting AI-based Video Manipulation27 Apr 2026
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detection5 Apr 2026
- 2026CIPHER: Counterfeit Image Pattern High-level Examination via Representation31 Mar 2026
38 more
- 2026From Masks to Pixels and Meaning: A New Taxonomy, Benchmark, and Metrics for VLM Image Tampering20 Mar 2026
- 2026Human-AI Ensembles Improve Deepfake Detection in Low-to-Medium Quality Videos15 Mar 2026
- 2026StegaFFD: Privacy-Preserving Face Forgery Detection via Fine-Grained Steganographic Domain Lifting3 Mar 2026
- 2026Leveraging large multimodal models for audio-video deepfake detection: a pilot study25 Feb 2026
- 2026Pixels Don't Lie (But Your Detector Might): Bootstrapping MLLM-as-a-Judge for Trustworthy Deepfake Detection and Reasoning Supervision23 Feb 2026
- 2026Deepfake Synthesis vs. Detection: An Uneven Contest8 Feb 2026
- 2026Can We Build a Monolithic Model for Fake Image Detection? SICA: Semantic-Induced Constrained Adaptation for Unified-Yet-Discriminative Artifact Feature Space Reconstruction6 Feb 2026
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2026Phase4DFD: Multi-Domain Phase-Aware Attention for Deepfake Detection9 Jan 2026
- 2026Fusion-SSAT: Unleashing the Potential of Self-supervised Auxiliary Task by Feature Fusion for Generalized Deepfake Detection2 Jan 2026
- 2025A Sanity Check for Multi-In-Domain Face Forgery Detection in the Real World4 Dec 2025
- 2025Do You See What I Say? Generalizable Deepfake Detection based on Visual Speech Recognition27 Nov 2025
- 2025Improving Deepfake Detection with Reinforcement Learning-Based Adaptive Data Augmentation10 Nov 2025
- 2025Proto-LeakNet: Towards Signal-Leak Aware Attribution in Synthetic Human Face Imagery6 Nov 2025
- 2025Through the Lens: Benchmarking Deepfake Detectors Against Moir'e-Induced Distortions27 Oct 2025
- 2025Seeing Through the Blur: Unlocking Defocus Maps for Deepfake Detection27 Sep 2025
- 2025FreqDebias: Towards Generalizable Deepfake Detection via Consistency-Driven Frequency Debiasing26 Sep 2025
- 2025Is It Certainly a Deepfake? Reliability Analysis in Detection & Generation Ecosystem22 Sep 2025
- 2025A Spatial-Frequency Aware Multi-Scale Fusion Network for Real-Time Deepfake Detection28 Aug 2025
- 2025MotionSwap8 Aug 2025
- 2025Visual Language Models as Zero-Shot Deepfake Detectors30 Jul 2025
- 2025HAMLET-FFD: Hierarchical Adaptive Multi-modal Learning Embeddings Transformation for Face Forgery Detection28 Jul 2025
- 2025Celeb-DF++: A Large-scale Challenging Video DeepFake Benchmark for Generalizable Forensics24 Jul 2025
- 2025Towards Trustworthy AI: Secure Deepfake Detection using CNNs and Zero-Knowledge Proofs22 Jul 2025
- 2025De-Fake: Style based Anomaly Deepfake Detection4 Jul 2025
- 2025Trident: Detecting Face Forgeries with Adversarial Triplet Learning29 Jun 2025
- 2025SELFI: Selective Fusion of Identity for Generalizable Deepfake Detection21 Jun 2025
- 2025FAME: A Lightweight Spatio-Temporal Network for Model Attribution of Face-Swap Deepfakes13 Jun 2025
- 2025LLMs Are Not Yet Ready for Deepfake Image Detection12 Jun 2025
- 2025Unleashing the Potential of Consistency Learning for Detecting and Grounding Multi-Modal Media Manipulation6 Jun 2025
- 2025RoGA: Towards Generalizable Deepfake Detection through Robust Gradient Alignment27 May 2025
- 2025CAD: A General Multimodal Framework for Video Deepfake Detection via Cross-Modal Alignment and Distillation21 May 2025
- 2025Multiscale Adaptive Conflict-Balancing Model For Multimedia Deepfake Detection19 May 2025
- 2025ForensicHub: A Unified Benchmark & Codebase for All-Domain Fake Image Detection and Localization16 May 2025
- 2025TT-DF: A Large-Scale Diffusion-Based Dataset and Benchmark for Human Body Forgery Detection13 May 2025
- 2025Video Forgery Detection for Surveillance Cameras: A Review4 May 2025
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakes7 Apr 2025
- 2025Mixture-of-Attack-Experts with Class Regularization for Unified Physical-Digital Face Attack Detection1 Apr 2025
50 newest of 180 All 180 (JSON)
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Modelscited by 6
- 2023On quantifying and improving realism of images generated with diffusioncited by 3
- 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Modelscited by 1
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detectioncited by 0
- 2026CIPHER: Counterfeit Image Pattern High-level Examination via Representationcited by 0
- 2026CIPHER: Counterfeit Image Pattern High-level Examination via Representation31 Mar 2026
- 2026Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection6 Feb 2026
- 2024AniFaceDiff: Animating Stylized Avatars via Parametric Conditioned Diffusion Models19 Jun 2024
- 2023On quantifying and improving realism of images generated with diffusion26 Sep 2023
- 2023On the Vulnerability of DeepFake Detectors to Attacks Generated by Denoising Diffusion Models11 Jul 2023
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 68
- 2025Visual Language Models as Zero-Shot Deepfake Detectorscited by 2
- 2026Leveraging large multimodal models for audio-video deepfake detection: a pilot studycited by 0
- 2026IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Modelscited by 0
- 2026IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Models17 Sep 2026
- 2026Leveraging large multimodal models for audio-video deepfake detection: a pilot study25 Feb 2026
- 2025Visual Language Models as Zero-Shot Deepfake Detectors30 Jul 2025
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensics21 Mar 2024
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 261
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2023UCF: Uncovering Common Features for Generalizable Deepfake Detectioncited by 177
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
- 2023DeepfakeBench: A Comprehensive Benchmark of Deepfake Detectioncited by 162
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 126
- 2021Local Relation Learning for Face Forgery Detectioncited by 100
- 2023Art and the science of generative AI: A deeper divecited by 93
- 2021Spatiotemporal Inconsistency Learning for DeepFake Video Detectioncited by 88
- 2024LAA-Net: Localized Artifact Attention Network for Quality-Agnostic and Generalizable Deepfake Detectioncited by 88
- 2021Deepfake Video Detection Using Convolutional Vision Transformercited by 79
12 most cited of 168 All 168 (JSON)
- 2026Trustworthy synthetic visual media: Evidence across the media lifecycle28 Sep 2026
- 2026Deep-Fake CAPTCHA: Mitigating Next-Generation Social Engineering Attacks10 Sep 2026
- 2026AdaForensics: Learning A Characteristic-aware Adaptive Deepfake Detector3 Aug 2026
- 2026Teacher-Student Structure for Domain Adaptation in Ensemble Audio-Visual Video Deepfake Detection13 Jun 2026
- 2026A Multi-Domain Feature Fusion Framework for Generalizable Deepfake Detection Across Different Generators12 Jun 2026
- 2026ClueAegis: Heuristic-to-Reasoning Cognitive-skill Learning for Unified Evidence-based Synthetic Image Detection24 May 2026
- 2026Venus-DeFakerOne: Unified Fake Image Detection & Localization13 May 2026
- 2026DYMAPIA: A Multi-Domain Framework for Detecting AI-based Video Manipulation27 Apr 2026
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detection5 Apr 2026
- 2026From Masks to Pixels and Meaning: A New Taxonomy, Benchmark, and Metrics for VLM Image Tampering20 Mar 2026
- 2026Human-AI Ensembles Improve Deepfake Detection in Low-to-Medium Quality Videos15 Mar 2026
- 2026StegaFFD: Privacy-Preserving Face Forgery Detection via Fine-Grained Steganographic Domain Lifting3 Mar 2026
12 newest of 168 All 168 (JSON)