Toward Robust Real-World Audio Deepfake Detection: Closing the Explainability Gap
Not on the map. Why?
Abstract (arXiv)
The rapid proliferation of AI-manipulated or generated audio deepfakes poses serious challenges to media integrity and election security. Current AI-driven detection solutions lack explainability and underperform in real-world settings. In this paper, we introduce novel explainability methods for state-of-the-art transformer-based audio deepfake detectors and open-source a novel benchmark for real-world generalizability. By narrowing the explainability gap between transformer-based audio deepfake detectors and traditional methods, our results not only build trust with human experts, but also pave the way for unlocking the potential of citizen intelligence to overcome the scalability issue in audio deepfake detection.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 30 of its 40 references that are in the map. First posted on arXiv 9 Oct 2024.
Builds on
30 of 40 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2020Quantifying Attention Flow in Transformerscited by 759
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 286
- 2021Rethinking and Improving Relative Position Encoding for Vision Transformercited by 206
- 2021FakeAVCeleb: A Novel Audio-Video Multimodal Deepfake Datasetcited by 179
18 more
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 158
- 2022Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detectioncited by 130
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 110
- 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 88
- 2023Self-Supervised Video Forensics by Audio-Visual Anomaly Detectioncited by 84
- 2018AudioMNIST: Exploring Explainable Artificial Intelligence for Audio Analysis on a Simple Benchmarkcited by 72
- 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 59
- 2019STC Antispoofing Systems for the ASVspoof2019 Challengecited by 51
- 2023Audio Deepfake Detection: A Surveycited by 49
- 2021Investigating self-supervised front ends for speech spoofing countermeasurescited by 43
- 2020Light Convolutional Neural Network with Feature Genuinization for Detection of Synthetic Speech Attackscited by 23
- 2022Waveform Boundary Detection for Partially Spoofed Audiocited by 15
- 2019Detecting Spoofing Attacks Using VGG and SincNet: BUT-Omilia Submission to ASVspoof 2019 Challengecited by 6
- 2023Real-time Detection of AI-Generated Speech for DeepFake Voice Conversioncited by 5
- 2020End-to-end spoofing detection with raw waveform CLDNNscited by 3
- 2024Continuous Learning of Transformer-based Audio Deepfake Detectioncited by 3
- 2021A Methodology for Exploring Deep Convolutional Features in Relation to Hand-Crafted Features with an Application to Music Audio Modelingcited by 1
- 2024AntiDeepFake: AI for Deep Fake Speech Recognitioncited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.