CLAD: Robust Audio Deepfake Detection Against Manipulation Attacks with Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
The increasing prevalence of audio deepfakes poses significant security threats, necessitating robust detection methods. While existing detection systems exhibit promise, their robustness against malicious audio manipulations remains underexplored. To bridge the gap, we undertake the first comprehensive study of the susceptibility of the most widely adopted audio deepfake detectors to manipulation attacks. Surprisingly, even manipulations like volume control can significantly bypass detection without affecting human perception. To address this, we propose CLAD (Contrastive Learning-based Audio deepfake Detector) to enhance the robustness against manipulation attacks. The key idea is to incorporate contrastive learning to minimize the variations introduced by manipulations, therefore enhancing detection robustness. Additionally, we incorporate a length loss, aiming to improve the detection accuracy by clustering real audios more closely in the feature space. We comprehensively evaluated the most widely adopted audio deepfake detection models and our proposed CLAD against various manipulation attacks. The detection models exhibited vulnerabilities, with FAR rising to 36.69%, 31.23%, and 51.28% under volume control, fading, and noise injection, respectively. CLAD enhanced robustness, reducing the FAR to 0.81% under noise injection and consistently maintaining an FAR below 1.63% across all tests. Our source code and documentation are available in the artifact repository (https://github.com/CLAD23/CLAD).
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 24 Apr 2024.
Builds on
33 of 52 references.
References · 33
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
- 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
- 2020Contrastive Learning of General-Purpose Audio Representationscited by 169
- 2020End-to-end anti-spoofing with RawNet2cited by 164
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
- 2023StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Modelscited by 152
- 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 149
- 2022Does Audio Deepfake Detection Generalize?cited by 135
21 more
- 2021Contrastive Learning based Hybrid Networks for Long-Tailed Image Classificationcited by 130
- 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 96
- 2022FreeVC: Towards High-Quality Text-Free One-Shot Voice Conversioncited by 80
- 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
- 2022Fair Contrastive Learning for Facial Attribute Classificationcited by 71
- 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
- 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 61
- 2019STC Antispoofing Systems for the ASVspoof2019 Challengecited by 51
- 2021Investigating self-supervised front ends for speech spoofing countermeasurescited by 46
- 2021Towards End-to-End Synthetic Speech Detectioncited by 38
- 2020DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voicescited by 24
- 2022AVQVC: One-shot Voice Conversion by Vector Quantization with applying contrastive learningcited by 24
- 2019Adversarial Attacks on Spoofing Countermeasures of automatic speaker verificationcited by 23
- 2022SASV 2022: The First Spoofing-Aware Speaker Verification Challengecited by 19
- 2022SAMO: Speaker Attractor Multi-Center One-Class Learning for Voice Anti-Spoofingcited by 18
- 2023What to Remember: Self-Adaptive Continual Learning for Audio Deepfake Detectioncited by 15
- 2021"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real Worldcited by 12
- 2023Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio Detectioncited by 11
- 2023Malafide: a novel adversarial convolutive noise attack against deepfake and spoofing detection systemscited by 10
- 2022StyleTTS-VC: One-Shot Voice Conversion by Knowledge Transfer from Style-Based TTS Modelscited by 9
- 2023Anomalous Sound Detection using Audio Representation with Machine ID based Contrastive Learning Pretrainingcited by 7
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 3.
9 papers.
- 2025Adversarial Attacks on Audio Deepfake Detection: A Benchmark and Comparative Studycited by 7
- 2024VoiceWukong: Benchmarking Deepfake Voice Detectioncited by 5
- 2024Secure Traffic Sign Recognition: An Attention-Enabled Universal Image Inpainting Mechanism against Light Patch Attackscited by 4
- 2025SHIELD: A Secure and Highly Enhanced Integrated Learning for Robust Deepfake Detection against Adversarial Attackscited by 3
- 2025What You Read Isn't What You Hear: Linguistic Sensitivity in Deepfake Speech Detectioncited by 1
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
- 2026Similarity Choice and Negative Scaling in Supervised Contrastive Learning for Deepfake Audio Detectioncited by 0
- 2026Proteus: Automated Adversarial Robustness Testing for Audio Deepfake Detectorscited by 0
- 2026Distinguishing AI-Generated Music from Edited Audio as a Hard-Negative Robustness Taskcited by 0
- 2026Distinguishing AI-Generated Music from Edited Audio as a Hard-Negative Robustness Task14 Aug 2026
- 2026Proteus: Automated Adversarial Robustness Testing for Audio Deepfake Detectors28 Jun 2026
- 2026Similarity Choice and Negative Scaling in Supervised Contrastive Learning for Deepfake Audio Detection28 Apr 2026
- 2025Adversarial Attacks on Audio Deepfake Detection: A Benchmark and Comparative Study8 Sep 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025SHIELD: A Secure and Highly Enhanced Integrated Learning for Robust Deepfake Detection against Adversarial Attacks17 Jul 2025
- 2025What You Read Isn't What You Hear: Linguistic Sensitivity in Deepfake Speech Detection23 May 2025
- 2024VoiceWukong: Benchmarking Deepfake Voice Detection10 Sep 2024
- 2024Secure Traffic Sign Recognition: An Attention-Enabled Universal Image Inpainting Mechanism against Light Patch Attacks6 Sep 2024