Fully Automated End-to-End Fake Audio Detection
Not on the map. Why?
Abstract (arXiv)
The existing fake audio detection systems often rely on expert experience to design the acoustic features or manually design the hyperparameters of the network structure. However, artificial adjustment of the parameters can have a relatively obvious influence on the results. It is almost impossible to manually set the best set of parameters. Therefore this paper proposes a fully automated end-toend fake audio detection method. We first use wav2vec pre-trained model to obtain a high-level representation of the speech. Furthermore, for the network structure, we use a modified version of the differentiable architecture search (DARTS) named light-DARTS. It learns deep speech representations while automatically learning and optimizing complex neural structures consisting of convolutional operations and residual blocks. The experimental results on the ASVspoof 2019 LA dataset show that our proposed system achieves an equal error rate (EER) of 1.08%, which outperforms the state-of-the-art single system.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 20 Aug 2022.
Builds on
20 of 34 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2017Tacotron: Towards End-to-End Speech Synthesiscited by 487
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 173
- 2020End-to-end anti-spoofing with RawNet2cited by 160
- 2021Emotion Recognition from Speech Using Wav2vec 2.0 Embeddingscited by 158
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 157
- 2015A Light CNN for Deep Face Representation with Noisy Labelscited by 126
- 2018LPCNet: Improving Neural Speech Synthesis Through Linear Predictioncited by 109
- 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 94
8 more
- 2020Exploring wav2vec 2.0 on speaker verification and language identificationcited by 93
- 2021Half-Truth: A Partially Fake Audio Detection Datasetcited by 44
- 2021Investigating self-supervised front ends for speech spoofing countermeasurescited by 43
- 2019Deep Residual Neural Networks for Audio Spoofing Detectioncited by 33
- 2022The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challengecited by 33
- 2021Continual Learning for Fake Audio Detectioncited by 27
- 2019ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworkscited by 23
- 2021Partially-Connected Differentiable Architecture Search for Deepfake and Spoofing Detectioncited by 9
Built on by
Citing papers per year: 2023: 4; 2024: 3; 2025: 2; 2026: 1.
10 papers.
- 2023Improved DeepFake Detection Using Whisper Featurescited by 28
- 2024Attentive Merging of Hidden Embeddings from Pre-trained Speech Model for Anti-spoofing Detectioncited by 17
- 2023Learning From Yourself: A Self-Distillation Method for Fake Speech Detectioncited by 9
- 2024Coarse-to-Fine Proposal Refinement Framework for Audio Temporal Forgery Detection and Localizationcited by 9
- 2023DF-TransFusion: Multimodal Deepfake Detection via Lip-Audio Cross-Attention and Facial Self-Attentioncited by 3
- 2024Exploring Green AI for Audio Deepfake Detectioncited by 1
- 2025Investigating self-supervised representations for audio-visual deepfake detectioncited by 1
- 2023Characterizing the temporal dynamics of universal speech representations for generalizable deepfake detectioncited by 0
- 20253-Tracer: A Tri-level Temporal-Aware Framework for Audio Forgery Detection and Localizationcited by 0
- 2026Quantizer-Aware Hierarchical Neural Codec Modeling for Speech Deepfake Detectioncited by 0
- 2026Quantizer-Aware Hierarchical Neural Codec Modeling for Speech Deepfake Detection10 Mar 2026
- 20253-Tracer: A Tri-level Temporal-Aware Framework for Audio Forgery Detection and Localization26 Nov 2025
- 2025Investigating self-supervised representations for audio-visual deepfake detection21 Nov 2025
- 2024Coarse-to-Fine Proposal Refinement Framework for Audio Temporal Forgery Detection and Localization23 Jul 2024
- 2024Attentive Merging of Hidden Embeddings from Pre-trained Speech Model for Anti-spoofing Detection12 Jun 2024
- 2024Exploring Green AI for Audio Deepfake Detection21 Mar 2024
- 2023Characterizing the temporal dynamics of universal speech representations for generalizable deepfake detection15 Sep 2023
- 2023DF-TransFusion: Multimodal Deepfake Detection via Lip-Audio Cross-Attention and Facial Self-Attention12 Sep 2023
- 2023Improved DeepFake Detection Using Whisper Features2 Jun 2023
- 2023Learning From Yourself: A Self-Distillation Method for Fake Speech Detection2 Mar 2023