Feature-Aligned Speech Watermarking for Robustness to Reconstruction Distortions
Not on the map. Why?
Abstract (arXiv)
Audio watermarking aims to embed identifiable information into audio while remaining imperceptible. Existing methods adopt high-fidelity, low-energy designs to preserve perceptual quality, but the resulting watermarks lack robustness under suppression by speech reconstruction models. Improving robustness is challenging due to the inherent robustness-fidelity trade-off in existing designs, where increasing watermark energy improves robustness but reduces fidelity. To address this problem, we propose a feature-aligned watermarking method that aligns the watermark with the original speech feature distribution, allowing higher watermark energy to improve robustness while preserving imperceptibility. We use a pretrained speech codec to generate a pseudo-speech watermark and fuse it into the spectrogram of the input audio, with VAD loss and perceptual losses guiding embedding within voiced regions. Experiments show that our method maintains imperceptibility comparable to existing approaches while substantially improving robustness under both seen and unseen speech reconstruction models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 20 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
14 of 20 references.
References · 14
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Modelscited by 226
- 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 192
- 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 153
- 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 78
- 2023WavMark: Watermarking for Audio Generationcited by 50
- 2023Detecting Voice Cloning Attacks via Timbre Watermarkingcited by 44
- 2025A Comprehensive Real-World Assessment of Audio Watermarking Algorithms: Will They Survive Neural Codecs?cited by 13
- 2025Deep Audio Watermarks are Shallow: Limitations of Post-Hoc Watermarking Techniques for Speechcited by 11
- 2025ClearerVoice-Studio: Bridging Advanced Speech Processing Research and Practical Deploymentcited by 11
- 2025SoK: How Robust is Audio Watermarking in Generative AI models?cited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024AudioMarkBench: Benchmarking Robustness of Audio Watermarking
- 2026CRAW: Codec Robust Audio Watermarking
- 2025Protecting Your Voice: Temporal-aware Robust Watermarking
- 2026Latent-Mark: An Audio Watermark Robust to Neural Codec Compression
- 2024Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesis
- 2024SilentCipher: Deep Audio Watermarking
- 2025AWARE: Audio Watermarking with Adversarial Resistance to Edits
- 2025Traceable TTS: Toward Watermark-Free TTS with Strong Traceability