mlsanityData to 14 Oct 2026

CLAD: Robust Audio Deepfake Detection Against Manipulation Attacks with Contrastive Learning

arXiv 2404.15854 ↗First posted 24 Apr 2024cs.CR cs.LG cs.SDcited by 9

Not on the map. Why?

Abstract (arXiv)

The increasing prevalence of audio deepfakes poses significant security threats, necessitating robust detection methods. While existing detection systems exhibit promise, their robustness against malicious audio manipulations remains underexplored. To bridge the gap, we undertake the first comprehensive study of the susceptibility of the most widely adopted audio deepfake detectors to manipulation attacks. Surprisingly, even manipulations like volume control can significantly bypass detection without affecting human perception. To address this, we propose CLAD (Contrastive Learning-based Audio deepfake Detector) to enhance the robustness against manipulation attacks. The key idea is to incorporate contrastive learning to minimize the variations introduced by manipulations, therefore enhancing detection robustness. Additionally, we incorporate a length loss, aiming to improve the detection accuracy by clustering real audios more closely in the feature space. We comprehensively evaluated the most widely adopted audio deepfake detection models and our proposed CLAD against various manipulation attacks. The detection models exhibited vulnerabilities, with FAR rising to 36.69%, 31.23%, and 51.28% under volume control, fading, and noise injection, respectively. CLAD enhanced robustness, reducing the FAR to 0.81% under noise injection and consistently maintaining an FAR below 1.63% across all tests. Our source code and documentation are available in the artifact repository (https://github.com/CLAD23/CLAD).

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 33 of its 52 references that are in the map. First posted on arXiv 24 Apr 2024.

Builds on

33 of 52 references.

References · 33

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  3. 2020Self-supervised Learning: Generative or Contrastivecited by 694
  4. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
  5. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
  6. 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
  7. 2020Contrastive Learning of General-Purpose Audio Representationscited by 169
  8. 2020End-to-end anti-spoofing with RawNet2cited by 164
  9. 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
  10. 2023StyleTTS 2: Towards Human-Level Text-to-Speech through Style Diffusion and Adversarial Training with Large Speech Language Modelscited by 152
  11. 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 149
  12. 2022Does Audio Deepfake Detection Generalize?cited by 135
21 more
  1. 2021Contrastive Learning based Hybrid Networks for Long-Tailed Image Classificationcited by 130
  2. 2022ADD 2022: the First Audio Deep Synthesis Detection Challengecited by 96
  3. 2022FreeVC: Towards High-Quality Text-Free One-Shot Voice Conversioncited by 80
  4. 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
  5. 2022Fair Contrastive Learning for Facial Attribute Classificationcited by 71
  6. 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
  7. 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 61
  8. 2019STC Antispoofing Systems for the ASVspoof2019 Challengecited by 51
  9. 2021Investigating self-supervised front ends for speech spoofing countermeasurescited by 46
  10. 2021Towards End-to-End Synthetic Speech Detectioncited by 38
  11. 2020DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voicescited by 24
  12. 2022AVQVC: One-shot Voice Conversion by Vector Quantization with applying contrastive learningcited by 24
  13. 2019Adversarial Attacks on Spoofing Countermeasures of automatic speaker verificationcited by 23
  14. 2022SASV 2022: The First Spoofing-Aware Speaker Verification Challengecited by 19
  15. 2022SAMO: Speaker Attractor Multi-Center One-Class Learning for Voice Anti-Spoofingcited by 18
  16. 2023What to Remember: Self-Adaptive Continual Learning for Audio Deepfake Detectioncited by 15
  17. 2021"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real Worldcited by 12
  18. 2023Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio Detectioncited by 11
  19. 2023Malafide: a novel adversarial convolutive noise attack against deepfake and spoofing detection systemscited by 10
  20. 2022StyleTTS-VC: One-Shot Voice Conversion by Knowledge Transfer from Style-Based TTS Modelscited by 9
  21. 2023Anomalous Sound Detection using Audio Representation with Machine ID based Contrastive Learning Pretrainingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 3.

9 papers.