Prompt Tuning for Audio Deepfake Detection: Computationally Efficient Test-time Domain Adaptation with Limited Target Dataset
Not on the map. Why?
Abstract (arXiv)
We study test-time domain adaptation for audio deepfake detection (ADD), addressing three challenges: (i) source-target domain gaps, (ii) limited target dataset size, and (iii) high computational costs. We propose an ADD method using prompt tuning in a plug-in style. It bridges domain gaps by integrating it seamlessly with state-of-the-art transformer models and/or with other fine-tuning methods, boosting their performance on target data (challenge (i)). In addition, our method can fit small target datasets because it does not require a large number of extra parameters (challenge (ii)). This feature also contributes to computational efficiency, countering the high computational costs typically associated with large-scale pre-trained models in ADD (challenge (iii)). We conclude that prompt tuning for ADD under domain gaps presents a promising avenue for enhancing accuracy with minimal target data and negligible extra computational burden.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 23 of its 33 references that are in the map. First posted on arXiv 13 Oct 2024.
Builds on
23 of 33 references.
References · 23
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2022Visual Prompt Tuningcited by 1,681
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 178
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
11 more
- 2022Does Audio Deepfake Detection Generalize?cited by 135
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 121
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
- 2020Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversioncited by 75
- 2023Improved DeepFake Detection Using Whisper Featurescited by 29
- 2021Continual Learning for Fake Audio Detectioncited by 27
- 2022SAMO: Speaker Attractor Multi-Center One-Class Learning for Voice Anti-Spoofingcited by 18
- 2023Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio Detectioncited by 11
- 2023Detection of Cross-Dataset Fake Audio Based on Prosodic and Pronunciation Featurescited by 10
- 2023Multi-Dataset Co-Training with Sharpness-Aware Optimization for Audio Anti-spoofingcited by 9
- 2023Phase perturbation improves channel robustness for speech spoofing countermeasurescited by 2
Built on by
Citing papers per year: 2024: 2; 2025: 3; 2026: 2.
7 papers.
- 2025Detect All-Type Deepfake Audio: Wavelet Prompt Tuning for Enhanced Auditory Perceptioncited by 7
- 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detectioncited by 5
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Surveycited by 4
- 2024RiTTA: Modeling Event Relations in Text-to-Audio Generationcited by 3
- 2026WaveScat: Wavelet Scattering Front-Ends with Self-Supervised Features for Speech Deepfake Detectioncited by 3
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
- 2026Learning as Deepfakes Evolve: RF-Prompt for Continual Audio Deepfake Detectioncited by 0
- 2026Learning as Deepfakes Evolve: RF-Prompt for Continual Audio Deepfake Detection29 Sep 2026
- 2026WaveScat: Wavelet Scattering Front-Ends with Self-Supervised Features for Speech Deepfake Detection3 Feb 2026
- 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detection6 Oct 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025Detect All-Type Deepfake Audio: Wavelet Prompt Tuning for Enhanced Auditory Perception9 Apr 2025
- 2024RiTTA: Modeling Event Relations in Text-to-Audio Generation20 Dec 2024
- 2024Passive Deepfake Detection Across Multi-modalities: A Comprehensive Survey26 Nov 2024