End-to-end Audio Deepfake Detection from RAW Waveforms: a RawNet-Based Approach with Cross-Dataset Evaluation
Not on the map. Why?
Abstract (arXiv)
Audio deepfakes represent a growing threat to digital security and trust, leveraging advanced generative models to produce synthetic speech that closely mimics real human voices. Detecting such manipulations is especially challenging under open-world conditions, where spoofing methods encountered during testing may differ from those seen during training. In this work, we propose an end-to-end deep learning framework for audio deepfake detection that operates directly on raw waveforms. Our model, RawNetLite, is a lightweight convolutional-recurrent architecture designed to capture both spectral and temporal features without handcrafted preprocessing. To enhance robustness, we introduce a training strategy that combines data from multiple domains and adopts Focal Loss to emphasize difficult or ambiguous samples. We further demonstrate that incorporating codec-based manipulations and applying waveform-level audio augmentations (e.g., pitch shifting, noise, and time stretching) leads to significant generalization improvements under realistic acoustic conditions. The proposed model achieves over 99.7% F1 and 0.25% EER on in-domain data (FakeOrReal), and up to 83.4% F1 with 16.4% EER on a challenging out-of-distribution test set (AVSpoof2021 + CodecFake). These findings highlight the importance of diverse training data, tailored objective functions and audio augmentations in building resilient and generalizable audio forgery detectors. Code and pretrained models are available at https://iplab.dmi.unict.it/mfs/Deepfakes/PaperRawNet2025/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 29 references that are in the map. First posted on arXiv 29 Apr 2025.
Builds on
14 of 29 references.
References · 14
- 2020The Creation and Detection of Deepfakes: A Surveycited by 247
- 2020DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detectioncited by 233
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 178
- 2020End-to-end anti-spoofing with RawNet2cited by 164
- 2023Audio Deepfake Detection: A Surveycited by 50
- 2024The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audiocited by 31
- 2023Audio Deepfake Detection with Self-Supervised WavLM and Multi-Fusion Attentive Classifiercited by 27
- 2024Leveraging Mixture of Experts for Improved Speech Deepfake Detectioncited by 15
- 2023GenAI Mirage: The Impostor Bias and the Deepfake Detection Challenge in the Era of Artificial Illusionscited by 10
- 2024Deepfake Media Forensics: State of the Art and Challenges Aheadcited by 7
- 2024One-Class Learning with Adaptive Centroid Shift for Audio Deepfake Detectioncited by 6
- 2022Deepfake Style Transfer Mixture: a First Forensic Ballistics Study on Synthetic Imagescited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.