mlsanityData to 14 Oct 2026

ERF-BA-TFD+: A Multimodal Model for Audio-Visual Deepfake Detection

arXiv 2508.17282 ↗First posted 24 Aug 2025cs.AI cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Deepfake detection is a critical task in identifying manipulated multimedia content. In real-world scenarios, deepfake content can manifest across multiple modalities, including audio and video. To address this challenge, we present ERF-BA-TFD+, a novel multimodal deepfake detection model that combines enhanced receptive field (ERF) and audio-visual fusion. Our model processes both audio and video features simultaneously, leveraging their complementary information to improve detection accuracy and robustness. The key innovation of ERF-BA-TFD+ lies in its ability to model long-range dependencies within the audio-visual input, allowing it to better capture subtle discrepancies between real and fake content. In our experiments, we evaluate ERF-BA-TFD+ on the DDL-AV dataset, which consists of both segmented and full-length video clips. Unlike previous benchmarks, which focused primarily on isolated segments, the DDL-AV dataset allows us to assess the model's performance in a more comprehensive and realistic setting. Our method achieves state-of-the-art results on this dataset, outperforming existing techniques in terms of both accuracy and processing speed. The ERF-BA-TFD+ model demonstrated its effectiveness in the "Workshop on Deepfake Detection, Localization, and Interpretability," Track 2: Audio-Visual Detection and Localization (DDL-AV), and won first place in this competition.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 24 Aug 2025.

Builds on

30 of 45 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  5. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  6. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  7. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  8. 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 519
  9. 2019BMN: Boundary-Matching Network for Temporal Action Proposal Generationcited by 329
  10. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 311
  11. 2020The Creation and Detection of Deepfakes: A Surveycited by 247
  12. 2021End-to-end Temporal Action Detection with Transformercited by 151
18 more
  1. 2023TriDet: Temporal Action Detection with Relative Boundary Modelingcited by 142
  2. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 129
  3. 2020Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cuescited by 111
  4. 2020Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localizationcited by 89
  5. 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
  6. 2020BSN++: Complementary Boundary Regressor with Scale-Balanced Relation Modeling for Temporal Action Proposal Generationcited by 65
  7. 2021Activity Graph Transformer for Temporal Action Localizationcited by 48
  8. 2025AI Flow: Perspectives, Scenarios, and Approachescited by 44
  9. 2022Positive-incentive Noisecited by 39
  10. 2023Variational Positive-incentive Noise: How Noise Benefits Modelscited by 38
  11. 2022BYOL for Audio: Exploring Pre-trained General-purpose Audio Representationscited by 36
  12. 2023Robustness and Generalizability of Deepfake Detection: A Study with Diffusion Modelscited by 36
  13. 2024Enhance Vision-Language Alignment with Noisecited by 34
  14. 2024Data Augmentation of Contrastive Learning is Estimating Positive-incentive Noisecited by 25
  15. 2021Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action Localizationcited by 21
  16. 2025Mimic In-Context Learning for Multimodal Taskscited by 12
  17. 2023Multi-spectral Class Center Network for Face Manipulation Detection and Localizationcited by 11
  18. 2024Mixture-of-Noises Enhanced Forgery-Aware Predictor for Multi-Face Manipulation Detection and Localizationcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.