Tell me Habibi, is it Real or Fake?
Not on the map. Why?
Abstract (arXiv)
Deepfake generation methods are evolving fast, making fake media harder to detect and raising serious societal concerns. Most deepfake detection and dataset creation research focuses on monolingual content, often overlooking the challenges of multilingual and code-switched speech, where multiple languages are mixed within the same discourse. Code-switching, especially between Arabic and English, is common in the Arab world and is widely used in digital communication. This linguistic mixing poses extra challenges for deepfake detection, as it can confuse models trained mostly on monolingual data. To address this, we introduce ArEnAV, the first large-scale Arabic-English audio-visual deepfake dataset featuring intra-utterance code-switching, dialectal variation, and monolingual Arabic content. It contains 387k videos and over 765 hours of real and fake videos. Our dataset is generated using a novel pipeline integrating four Text-To-Speech and two lip-sync models, enabling comprehensive analysis of multilingual multimodal deepfake detection. We benchmark our dataset against existing monolingual and multilingual datasets, state-of-the-art deepfake detection models, and a human evaluation, highlighting its potential to advance deepfake research. The dataset can be accessed hrefhttps://huggingface.co/datasets/kartik060702/ArEnAV-Fullhere.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 28 May 2025.
Builds on
28 of 40 references.
References · 28
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 632
- 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
- 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2020DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detectioncited by 254
- 2020Real Time Speech Enhancement in the Waveform Domaincited by 186
16 more
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 181
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 178
- 2021ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysiscited by 126
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 121
- 2021KoDF: A Large-scale Korean DeepFake Detection Datasetcited by 80
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2024LatentSync: Taming Audio-Conditioned Latent Diffusion Models for Lip Sync with SyncNet Supervisioncited by 56
- 2023Diff2Lip: Audio Conditioned Diffusion Models for Lip-Synchronizationcited by 49
- 2023Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localizationcited by 43
- 2021QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpuscited by 38
- 2024XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detectioncited by 30
- 2024Heterogeneity over Homogeneity: Investigating Multilingual Speech Pre-Trained Models for Detecting Audio Deepfakecited by 14
- 2024ZAEBUC-Spoken: A Multilingual Multidialectal Arabic-English Speech Corpuscited by 10
- 2025A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directionscited by 5
Built on by
Citing papers per year: 2025: 4; 2026: 2.
6 papers.
- 2025AV-Deepfake1M++: A Large-Scale Audio-Visual Deepfake Benchmark with Real-World Perturbationscited by 8
- 2025DDL: A Large-Scale Dataset for Deepfake Detection and Localization in Diversified Real-World Scenarioscited by 4
- 2025LayLens: Improving Deepfake Understanding through Simplified Explanationscited by 2
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Surveycited by 1
- 2025ArFake: A Robust Framework for Multi-Dialect Arabic Speech Spoofing Detection Benchmarkcited by 0
- 2026BioLip: Language-Generalizable Lip-Sync Deepfake Detection via Biomechanical Constraint Violation Modelingcited by 0
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Survey12 Jul 2026
- 2026BioLip: Language-Generalizable Lip-Sync Deepfake Detection via Biomechanical Constraint Violation Modeling18 Apr 2026
- 2025ArFake: A Robust Framework for Multi-Dialect Arabic Speech Spoofing Detection Benchmark26 Sep 2025
- 2025AV-Deepfake1M++: A Large-Scale Audio-Visual Deepfake Benchmark with Real-World Perturbations28 Jul 2025
- 2025LayLens: Improving Deepfake Understanding through Simplified Explanations14 Jul 2025
- 2025DDL: A Large-Scale Dataset for Deepfake Detection and Localization in Diversified Real-World Scenarios29 Jun 2025