Adaptive Compression and Targeted Perturbation: A Unified Framework for Generalized Audio Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
Existing audio deepfake detection (ADD) methods frequently exhibit limited generalization, as fixed bottleneck architectures fail to adapt to the heterogeneous information densities inherent in diverse spoofing artifacts. Moreover, standard augmentation often leads to a pathological robustness-accuracy trade-off. In this paper, we propose a unified ADD framework to address these challenges. Our approach integrates: (1) an Adaptive Audio Feature Integration (AAFI) module that dynamically selects optimal latent dimensions via a compression pool and a stochastic exploration mechanism, ensuring flexible representations across multiple types of dynamic attacks; and (2) a Mel-Band Adversarial Perturbation (Mel-BAP) strategy that applies targeted regularization in the mel-spectrogram domain to encourage the model to learn invariant decision boundaries. Extensive evaluations on benchmarks including ADD 2022, FakeOrReal, and In-the-Wild demonstrate that our model based on Whisper-small achieves a state-of-the-art average Equal Error Rate (EER) of 1.51%. Compared to existing SOTA models such as the 3-billion-parameter Resemble-Detect-3B-Omni, our framework reduces the parameter count by up to 91.6% while achieving a 60.7% improvement in average EER. In a separate cross-lingual evaluation, the Whisper-base configuration achieves EERs of 3.91-5.65% on five unseen languages. The framework also maintains strong resilience to real-world acoustic distortions. This work provides a scalable and efficient "plug-in" solution for enhancing trust and security in the audio Web ecosystem.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
38 of 54 references.
References · 38
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,517
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
- 2019Deep Learning for Anomaly Detection: A Surveycited by 358
- 2021A Survey on Neural Speech Synthesiscited by 184
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 178
- 2020End-to-end anti-spoofing with RawNet2cited by 164
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
- 2023UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecastingcited by 144
26 more
- 2022Does Audio Deepfake Detection Generalize?cited by 135
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
- 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 96
- 2023How Does Information Bottleneck Help Deep Learning?cited by 93
- 2021End-to-End Spectro-Temporal Graph Attention Networks for Speaker Verification Anti-Spoofing and Speech Deepfake Detectioncited by 70
- 2021ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speechcited by 58
- 2022The Vicomtech Audio Deepfake Detection System based on Wav2Vec2 for the 2022 ADD Challengecited by 35
- 2022An Overview of Affective Speech Synthesis and Conversion in the Deep Learning Eracited by 33
- 2024XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detectioncited by 30
- 2023Improved DeepFake Detection Using Whisper Featurescited by 29
- 2023Audio Deepfake Detection with Self-Supervised WavLM and Multi-Fusion Attentive Classifiercited by 27
- 2024A Survey on Speech Deepfake Detectioncited by 27
- 2024Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detectioncited by 25
- 2024FlashSpeech: Efficient Zero-Shot Speech Synthesiscited by 24
- 2024SafeEar: Content Privacy-Preserving Audio Deepfake Detectioncited by 21
- 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 19
- 2024CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systemscited by 16
- 2024Leveraging Mixture of Experts for Improved Speech Deepfake Detectioncited by 15
- 2024I Can Hear You: Selective Robust Training for Deepfake Audio Detectioncited by 13
- 2024Towards Fairness-Aware Adversarial Learningcited by 11
- 2025BiCrossMamba-ST: Speech Deepfake Detection with Bidirectional Mamba Spectro-Temporal Cross-Attentioncited by 10
- 2023The defender's perspective on automatic speaker verification: An overviewcited by 9
- 2025SpeechFake: A Large-Scale Multilingual Speech Deepfake Dataset Incorporating Cutting-Edge Generation Methodscited by 7
- 2021Fooling Object Detectors: Adversarial Attacks by Half-Neighbor Maskscited by 6
- 2025RawTFNet: A Lightweight CNN Architecture for Speech Anti-spoofingcited by 4
- 2021Dynamic Efficient Adversarial Training Guided by Gradient Magnitudecited by 2
Built on by
Not cited yet.