Securing Voice-driven Interfaces against Fake (Cloned) Audio Attacks
Not on the map. Why?
Abstract (arXiv)
Voice cloning technologies have found applications in a variety of areas ranging from personalized speech interfaces to advertisement, robotics, and so on. Existing voice cloning systems are capable of learning speaker characteristics and use trained models to synthesize a person's voice from only a few audio samples. Advances in cloned speech generation technologies are capable of generating perceptually indistinguishable speech from a bona-fide speech. These advances pose new security and privacy threats to voice-driven interfaces and speech-based access control systems. The state-of-the-art speech synthesis technologies use trained or tuned generative models for cloned speech generation. Trained generative models rely on linear operations, learned weights, and excitation source for cloned speech synthesis. These systems leave characteristic artifacts in the synthesized speech. Higher-order spectral analysis is used to capture differentiating attributes between bona-fide and cloned audios. Specifically, quadrature phase coupling (QPC) in the estimated bicoherence, Gaussianity test statistics, and linearity test statistics are used to capture generative model artifacts. Performance of the proposed method is evaluated on cloned audios generated using speaker adaptation- and speaker encoding-based approaches. Experimental results for a dataset consisting of 126 cloned speech and 8 bona-fide speech samples indicate that the proposed method is capable of detecting bona-fide and cloned audios with close to a perfect detection rate.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 0; 2024: 1.
5 papers.
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2024EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Controlcited by 13
- 2022Combining Automatic Speaker Verification and Prosody Analysis for Synthetic Speech Detectioncited by 6
- 2022Frequency Domain-Based Detection of Generated Audiocited by 3
- 2022Faked Speech Detection with Zero Prior Knowledgecited by 1
- 2024EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion Control1 Oct 2024
- 2022Combining Automatic Speaker Verification and Prosody Analysis for Synthetic Speech Detection31 Oct 2022
- 2022Faked Speech Detection with Zero Prior Knowledge26 Sep 2022
- 2022Frequency Domain-Based Detection of Generated Audio3 May 2022
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward25 Feb 2021