TALL: Thumbnail Layout for Deepfake Video Detection
Not on the map. Why?
Abstract (arXiv)
The growing threats of deepfakes to society and cybersecurity have raised enormous public concerns, and increasing efforts have been devoted to this critical topic of deepfake video detection. Existing video methods achieve good performance but are computationally intensive. This paper introduces a simple yet effective strategy named Thumbnail Layout (TALL), which transforms a video clip into a pre-defined layout to realize the preservation of spatial and temporal dependencies. Specifically, consecutive frames are masked in a fixed position in each frame to improve generalization, then resized to sub-images and rearranged into a pre-defined layout as the thumbnail. TALL is model-agnostic and extremely simple by only modifying a few lines of code. Inspired by the success of vision transformers, we incorporate TALL into Swin Transformer, forming an efficient and effective method TALL-Swin. Extensive experiments on intra-dataset and cross-dataset validate the validity and superiority of TALL and SOTA TALL-Swin. TALL-Swin achieves 90.79% AUC on the challenging cross-dataset task, FaceForensics++ → Celeb-DF. The code is available at https://github.com/rainy-xu/TALL4Deepfake.
Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). Builds on 82 of its 109 references that are in the map. First posted on arXiv 14 Jul 2023.
Builds on
82 of 109 references.
References · 82
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
38 more
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2021ViViT: A Video Vision Transformercited by 1,610
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 895
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 842
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 573
- 2017Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classificationcited by 521
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 518
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
- 2019Face X-ray for More General Face Forgery Detectioncited by 469
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2021Multi-attentional Deepfake Detectioncited by 339
- 2022Detecting Deepfakes with Self-Blended Imagescited by 332
- 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 318
- 2018Exposing Deep Fakes Using Inconsistent Head Posescited by 294
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
- 2020What makes fake images detectable? Understanding properties that generalizecited by 272
- 2021Video Transformer Networkcited by 271
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 251
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 241
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2020Media Forensics and DeepFakes: an overviewcited by 208
- 2021WildDeepfake: A Challenging Real-World Dataset for Deepfake Detectioncited by 207
- 2017Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognitioncited by 178
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 177
- 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
- 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 133
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2019Recurrent Convolutional Strategies for Face Manipulation Detection in Videoscited by 118
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
50 most cited of 82 All 82 (JSON)
Built on by
Citing papers per year: 2023: 5; 2024: 29; 2025: 36; 2026: 30.
100 papers.
Sort:
By area:
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 102
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 85
- 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 57
- 2024FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledgecited by 48
- 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
- 2024On Learning Multi-Modal Forgery Representation for Diffusion Generated Video Detectioncited by 40
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 38
- 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Modelcited by 37
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2025AI-Generated Video Detection via Perceptual Straighteningcited by 34
- 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Featurescited by 32
- 2024Standing on the Shoulders of Giants: Reprogramming Visual-Language Model for General Deepfake Detectioncited by 30
38 more
- 2024Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detectioncited by 30
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
- 2025GenVidBench: A 6-Million Benchmark for AI-Generated Video Detectioncited by 23
- 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Contentcited by 22
- 2024Learning Spatiotemporal Inconsistency via Thumbnail Layout for Face Deepfake Detectioncited by 21
- 2024FSFM: A Generalizable Face Security Foundation Model via Self-Supervised Facial Representation Learningcited by 21
- 2025Unlocking the Capabilities of Large Vision-Language Models for Generalizable and Explainable Deepfake Detectioncited by 20
- 2024Generative Unlearning for Any Identitycited by 19
- 2025Learning Human-Perceived Fakeness in AI-Generated Videos via Multimodal LLMscited by 16
- 2025From Specificity to Generality: Revisiting Generalizable Artifacts in Detecting Face Deepfakescited by 14
- 2026Your One-Stop Solution for AI-Generated Video Detectioncited by 13
- 2026VideoVeritas: AI-Generated Video Detection via Perception Pretext Reinforcement Learningcited by 11
- 2024Deepfake Media Generation and Detection in the Generative AI Era: A Survey and Outlookcited by 10
- 2025TalkingHeadBench: A Multi-Modal Benchmark & Analysis of Talking-Head DeepFake Detectioncited by 10
- 2025MAVOS-DD: Multilingual Audio-Video Open-Set Deepfake Detection Benchmarkcited by 9
- 2023DomainForensics: Exposing Face Forgery across Domains via Bi-directional Adaptationcited by 8
- 2024Semantic Contextualization of Face Forgery: A New Definition, Dataset, and Detection Methodcited by 8
- 2024ED4: Explicit Data-level Debiasing for Deepfake Detectioncited by 8
- 2025Vulnerability-Aware Spatio-Temporal Learning for Generalizable Deepfake Video Detectioncited by 8
- 2026Preserving Forgery Artifacts: AI-Generated Video Detection at Native Scalecited by 8
- 2023An adversarial attack approach for eXplainable AI evaluation on deepfake detection modelscited by 7
- 2025GenWorld: Towards Detecting AI-generated Real-world Simulation Videoscited by 7
- 2025DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysiscited by 7
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
- 2024FakeFormer: Efficient Vulnerability-Driven Transformers for Generalisable Deepfake Detectioncited by 6
- 2025CAD: A General Multimodal Framework for Video Deepfake Detection via Cross-Modal Alignment and Distillationcited by 6
- 2023Vision-Language Models Learn Super Images for Efficient Partially Relevant Video Retrievalcited by 5
- 2026On the Holistic Approach for Detecting Human Image Forgerycited by 5
- 2024Compressed Deepfake Video Detection Based on 3D Spatiotemporal Trajectoriescited by 4
- 2024Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approachcited by 4
- 2024A Hitchhikers Guide to Fine-Grained Face Forgery Detection Using Common Sense Reasoningcited by 4
- 2024A Quality-Centric Framework for Generic Deepfake Detectioncited by 4
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Surveycited by 4
- 2024UniForensics: Face Forgery Detection via General Facial Representationcited by 3
- 2025FakeParts: a New Family of AI-Generated DeepFakescited by 3
- 2025AuViRe: Audio-visual Speech Representation Reconstruction for Deepfake Temporal Localizationcited by 3
- 2024Tex-ViT: A Generalizable, Robust, Texture-based dual-branch cross-attention deepfake detectorcited by 2
- 2024FaceTracer: Unveiling Source Identities from Swapped Face Images and Videos for Fraud Preventioncited by 2
50 most cited of 100 All 100 (JSON)
- 2026Preserving Knowledge across Space and Time for Continual Video Deepfake Detection3 Sep 2026
- 2026Swin Meets EfficientNet: Lightweight Architectures for GAN-Based Face Forensics1 Sep 2026
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Environment-Invariant Subspace Learning for Generalizable Deepfake Detection18 Aug 2026
- 2026Learning Unified Video and Image Representation for Video Face Forgery Detection13 Aug 2026
- 2026Grad-CAM for Vision Transformers: A Systematic Taxonomy and Audit of Methodological Ambiguity in Explainable AI5 Aug 2026
- 2026G2VD: Generalizable AI-Generated Video Detection via Counterfactual Intervention and Causal Disentanglement6 Jul 2026
- 2026SafeGuard: A Multi-Agent Perception-Reasoning Framework for Social-Risk AI-Generated Video Detection3 Jul 2026
- 2026SPLIT: Training-Free AI-Generated and Partially Edited Video Detection via Spatial Patch-Level Incoherence and Temporal Roughness3 Jul 2026
- 2026Dataset Biases and Shortcut Learning in Motion-Based AI-Generated Video Detection1 Jul 2026
- 2026SpecSem-Net: Integrating Spectral and Semantic Features for Robust AI-generated Video Detection17 May 2026
- 2026CAM-VFD: Cross-Attention Multimodal Video Forgery Detection16 May 2026
38 more
- 2026Exposing and Mitigating Temporal Attack in Deepfake Video Detection8 May 2026
- 2026Detecting AI-Generated Videos with Spiking Neural Networks7 May 2026
- 2026CMTA: Leveraging Cross-Modal Temporal Artifacts for Generalizable AI-Generated Video Detection1 May 2026
- 2026MSCT: Differential Cross-Modal Attention for Deepfake Detection9 Apr 2026
- 2026Preserving Forgery Artifacts: AI-Generated Video Detection at Native Scale6 Apr 2026
- 2026LAA-X: Unified Localized Artifact Attention for Quality-Agnostic and Generalizable Face Forgery Detection5 Apr 2026
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detection25 Mar 2026
- 2026Tutor-Student Reinforcement Learning: A Dynamic Curriculum for Robust Deepfake Detection25 Mar 2026
- 2026Human-AI Ensembles Improve Deepfake Detection in Low-to-Medium Quality Videos15 Mar 2026
- 2026Na"ive Exposure of Generative AI Capabilities Undermines Deepfake Detection11 Mar 2026
- 2026SWIFT: Sliding Window Reconstruction for Few-Shot Training-Free Generated Video Attribution9 Mar 2026
- 2026Leveraging large multimodal models for audio-video deepfake detection: a pilot study25 Feb 2026
- 2026EA-Swin: An Embedding-Agnostic Swin Transformer for AI-Generated Video Detection19 Feb 2026
- 2026VideoVeritas: AI-Generated Video Detection via Perception Pretext Reinforcement Learning9 Feb 2026
- 2026MPF-Net: Exposing High-Fidelity AI-Generated Video Forgeries via Hierarchical Manifold Deviation and Micro-Temporal Fluctuations29 Jan 2026
- 2026Low-rank Orthogonal Subspace Intervention for Generalizable Face Forgery Detection17 Jan 2026
- 2026Your One-Stop Solution for AI-Generated Video Detection16 Jan 2026
- 2026On the Holistic Approach for Detecting Human Image Forgery8 Jan 2026
- 2025FakeRadar: Probing Forgery Outliers to Detect Unknown Deepfake Videos16 Dec 2025
- 2025Grab-3D: Detecting AI-Generated Videos from 3D Geometric Temporal Consistency15 Dec 2025
- 2025Towards Robust DeepFake Detection under Unstable Face Sequences: Adaptive Sparse Graph Embedding with Order-Free Representation and Explicit Laplacian Spectral Prior8 Dec 2025
- 2025Beyond Flicker: Detecting Kinematic Inconsistencies for Generalizable Deepfake Video Detection3 Dec 2025
- 2025OmniFD: A Unified Model for Versatile Face Forgery Detection30 Nov 2025
- 2025AuViRe: Audio-visual Speech Representation Reconstruction for Deepfake Temporal Localization24 Nov 2025
- 2025UMCL: Unimodal-generated Multimodal Contrastive Learning for Cross-compression-rate Deepfake Detection24 Nov 2025
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learning22 Nov 2025
- 2025SAGA: Source Attribution of Generative AI Videos16 Nov 2025
- 2025Fine-Grained DINO Tuning with Dual Supervision for Face Forgery Detection15 Nov 2025
- 2025Next-Frame Feature Prediction for Multimodal Deepfake Detection and Temporal Localization13 Nov 2025
- 2025DeepShield: Fortifying Deepfake Video Detection with Local and Global Forgery Analysis29 Oct 2025
- 2025Unmasking Puppeteers: Leveraging Biometric Leakage to Expose Impersonation in AI-Based Videoconferencing3 Oct 2025
- 2025Learning Human-Perceived Fakeness in AI-Generated Videos via Multimodal LLMs26 Sep 2025
- 2025FakeParts: a New Family of AI-Generated DeepFakes28 Aug 2025
- 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Features1 Aug 2025
- 2025Seeing Through Deepfakes: A Human-Inspired Framework for Multi-Face Detection20 Jul 2025
- 2025AI-Generated Video Detection via Perceptual Straightening1 Jul 2025
- 2025Trident: Detecting Face Forgeries with Adversarial Triplet Learning29 Jun 2025
- 2025SELFI: Selective Fusion of Identity for Generalizable Deepfake Detection21 Jun 2025
50 newest of 100 All 100 (JSON)
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detectorcited by 38
- 2024Standing on the Shoulders of Giants: Reprogramming Visual-Language Model for General Deepfake Detectioncited by 30
- 2025Unlocking the Capabilities of Large Vision-Language Models for Generalizable and Explainable Deepfake Detectioncited by 20
- 2025Learning Human-Perceived Fakeness in AI-Generated Videos via Multimodal LLMscited by 16
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challengescited by 6
- 2023Vision-Language Models Learn Super Images for Efficient Partially Relevant Video Retrievalcited by 5
- 2026Leveraging large multimodal models for audio-video deepfake detection: a pilot studycited by 0
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detectioncited by 0
- 2026Unleashing Vision-Language Semantics for Deepfake Video Detection25 Mar 2026
- 2026Leveraging large multimodal models for audio-video deepfake detection: a pilot study25 Feb 2026
- 2025Learning Human-Perceived Fakeness in AI-Generated Videos via Multimodal LLMs26 Sep 2025
- 2025Rethinking Vision-Language Model in Face Forensics: Multi-Modal Interpretable Forged Face Detector26 Mar 2025
- 2025Unlocking the Capabilities of Large Vision-Language Models for Generalizable and Explainable Deepfake Detection19 Mar 2025
- 2024Standing on the Shoulders of Giants: Reprogramming Visual-Language Model for General Deepfake Detection4 Sep 2024
- 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges11 Jun 2024
- 2023Vision-Language Models Learn Super Images for Efficient Partially Relevant Video Retrieval1 Dec 2023
- 2024On Learning Multi-Modal Forgery Representation for Diffusion Generated Video Detectioncited by 40
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusioncited by 29
- 2025Grab-3D: Detecting AI-Generated Videos from 3D Geometric Temporal Consistencycited by 1
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learningcited by 0
- 2025Grab-3D: Detecting AI-Generated Videos from 3D Geometric Temporal Consistency15 Dec 2025
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learning22 Nov 2025
- 2024On Learning Multi-Modal Forgery Representation for Diffusion Generated Video Detection31 Oct 2024
- 2024DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion6 Oct 2024
- 2024Generative Unlearning for Any Identitycited by 19
- 2024Generative Unlearning for Any Identity16 May 2024
- 2025WMamba: Wavelet-based Mamba for Face Forgery Detectioncited by 2
- 2025WMamba: Wavelet-based Mamba for Face Forgery Detection16 Jan 2025
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 102
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 85
- 2024Generalizing Deepfake Video Detection with Plug-and-Play: Video-Level Blending and Spatiotemporal Adapter Tuningcited by 57
- 2024FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledgecited by 48
- 2023Towards General Visual-Linguistic Face Forgery Detectioncited by 45
- 2024Towards More General Video-based Deepfake Detection through Facial Component Guided Adaptation for Foundation Modelcited by 37
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2025AI-Generated Video Detection via Perceptual Straighteningcited by 34
- 2025D3: Training-Free AI-Generated Video Detection Using Second-Order Featurescited by 32
- 2024Fake It till You Make It: Curricular Dynamic Forgery Augmentations towards General Deepfake Detectioncited by 30
- 2025GenVidBench: A 6-Million Benchmark for AI-Generated Video Detectioncited by 23
- 2024Towards a Universal Synthetic Video Detector: From Face or Background Manipulations to Fully AI-Generated Contentcited by 22
12 most cited of 83 All 83 (JSON)
- 2026Preserving Knowledge across Space and Time for Continual Video Deepfake Detection3 Sep 2026
- 2026Swin Meets EfficientNet: Lightweight Architectures for GAN-Based Face Forensics1 Sep 2026
- 2026Environment-Invariant Subspace Learning for Generalizable Deepfake Detection18 Aug 2026
- 2026Learning Unified Video and Image Representation for Video Face Forgery Detection13 Aug 2026
- 2026Grad-CAM for Vision Transformers: A Systematic Taxonomy and Audit of Methodological Ambiguity in Explainable AI5 Aug 2026
- 2026G2VD: Generalizable AI-Generated Video Detection via Counterfactual Intervention and Causal Disentanglement6 Jul 2026
- 2026SPLIT: Training-Free AI-Generated and Partially Edited Video Detection via Spatial Patch-Level Incoherence and Temporal Roughness3 Jul 2026
- 2026Dataset Biases and Shortcut Learning in Motion-Based AI-Generated Video Detection1 Jul 2026
- 2026SpecSem-Net: Integrating Spectral and Semantic Features for Robust AI-generated Video Detection17 May 2026
- 2026CAM-VFD: Cross-Attention Multimodal Video Forgery Detection16 May 2026
- 2026Exposing and Mitigating Temporal Attack in Deepfake Video Detection8 May 2026
- 2026Detecting AI-Generated Videos with Spiking Neural Networks7 May 2026
12 newest of 83 All 83 (JSON)