Self Voice Conversion as an Attack against Neural Audio Watermarking
Not on the map. Why?
Abstract (arXiv)
Audio watermarking embeds auxiliary information into speech while maintaining speaker identity, linguistic content, and perceptual quality. Although recent advances in neural and digital signal processing-based watermarking methods have improved imperceptibility and embedding capacity, robustness is still primarily assessed against conventional distortions such as compression, additive noise, and resampling. However, the rise of deep learning-based attacks introduces novel and significant threats to watermark security. In this work, we investigate self voice conversion as a universal, content-preserving attack against audio watermarking systems. Self voice conversion remaps a speaker's voice to the same identity while altering acoustic characteristics through a voice conversion model. We demonstrate that this attack severely degrades the reliability of state-of-the-art watermarking approaches and highlight its implications for the security of modern audio watermarking techniques.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 35 of its 45 references that are in the map. First posted on arXiv 28 Jan 2026.
Builds on
35 of 45 references.
References · 35
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 649
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 431
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 390
- 2018WaveGlow: A Flow-based Generative Network for Speech Synthesiscited by 309
- 2023NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizerscited by 235
23 more
- 2020An Overview of Voice Conversion and its Challenges: From Statistical Modeling to Deep Learningcited by 112
- 2018CREPE: A Convolutional Representation for Pitch Estimationcited by 110
- 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 78
- 2023Voice Conversion With Just Nearest Neighborscited by 68
- 2021A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detectioncited by 56
- 2023WavMark: Watermarking for Audio Generationcited by 50
- 2023Detecting Voice Cloning Attacks via Timbre Watermarkingcited by 44
- 2024AudioMarkBench: Benchmarking Robustness of Audio Watermarkingcited by 23
- 2022DeAR: A Deep-learning-based Audio Re-recording Resilient Watermarkingcited by 22
- 2024SilentCipher: Deep Audio Watermarkingcited by 21
- 2024GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesiscited by 21
- 2022The VoicePrivacy 2022 Challenge Evaluation Plancited by 18
- 2025A Comprehensive Real-World Assessment of Audio Watermarking Algorithms: Will They Survive Neural Codecs?cited by 13
- 2019Neural Harmonic-plus-Noise Waveform Model with Trainable Maximum Voice Frequency for Text-to-Speech Synthesiscited by 11
- 2025Deep Audio Watermarks are Shallow: Limitations of Post-Hoc Watermarking Techniques for Speechcited by 11
- 2025SoK: How Robust is Audio Watermarking in Generative AI models?cited by 10
- 2023Who is Speaking Actually? Robust and Versatile Speaker Traceability for Voice Conversioncited by 5
- 2025XAttnMark: Learning Robust Audio Watermarking with Cross-Attentioncited by 5
- 2023Catch You and I Can: Revealing Source Voiceprint Against Voice Conversioncited by 4
- 2024WMCodec: End-to-End Neural Speech Codec with Deep Watermarking for Authenticity Verificationcited by 4
- 2024Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesiscited by 4
- 2025VoiceMark: Zero-Shot Voice Cloning-Resistant Watermarking Approach Leveraging Speaker-Specific Latentscited by 3
- 2025A Comparative Study on Proactive and Passive Detection of Deepfake Speechcited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Latent-Mark: An Audio Watermark Robust to Neural Codec Compressioncited by 1
- 2026The Watermark Shortcut: How Provenance Marking Sabotages Audio Deepfake Detectioncited by 1
- 2026What Counts as Real? Speech Restoration and Voice Quality Conversion Pose New Challenges to Deepfake Detectioncited by 0
- 2026From Scores to Evidence: Auditable Decisions Can Improve Speech Deepfake Detectioncited by 0
- 2026From Scores to Evidence: Auditable Decisions Can Improve Speech Deepfake Detection8 Sep 2026
- 2026The Watermark Shortcut: How Provenance Marking Sabotages Audio Deepfake Detection22 Jun 2026
- 2026What Counts as Real? Speech Restoration and Voice Quality Conversion Pose New Challenges to Deepfake Detection14 Mar 2026
- 2026Latent-Mark: An Audio Watermark Robust to Neural Codec Compression5 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025The Impact of Audio Watermarking on Audio Anti-Spoofing Countermeasures
- 2025Yours or Mine? Overwriting Attacks Against Neural Audio Watermarking
- 2025VocalCrypt: Novel Active Defense Against Deepfake Voice Based on Masking Effect ↗
- 2026The Vulnerability of Neural Audio Watermarks under Speech Enhancement ↗
- 2026Learning to Evade: Adaptive Attacks on Audio Watermarking ↗
- 2025AWARE: Audio Watermarking with Adversarial Resistance to Edits
- 2026CRAW: Codec Robust Audio Watermarking
- 2026Combining Self-Embedding Audio Watermarking with Ultra-Low-Bitrate Neural Codecs