Latent-Mark: An Audio Watermark Robust to Neural Codec Compression
Not on the map. Why?
Abstract (arXiv)
While existing audio watermarking techniques have achieved strong robustness against traditional digital signal processing (DSP) attacks, they remain vulnerable to neural compression. This occurs because modern neural audio codecs act as noise filters and discard the imperceptible waveform variations used in prior watermarking methods. To address this limitation, we propose Latent-Mark, the first zero-bit audio watermarking framework designed to survive neural codec compression. Our key insight is that robustness to the encode-decode process requires embedding the watermark within the codec's invariant latent space. We achieve this by optimizing the audio waveform to induce a detectable directional shift in its encoded latent representation, while constraining perturbations to align with the natural audio manifold to ensure imperceptibility. To prevent overfitting to a single codec's quantization rules, we introduce Cross-Codec Optimization, jointly optimizing the waveform across multiple surrogate codecs to target shared latent invariants. Extensive evaluations demonstrate robust zero-shot transferability to unseen neural codecs, achieving competitive resilience against traditional DSP attacks while preserving perceptual imperceptibility. We hope our work will inspire future research into universal watermarking frameworks capable of maintaining integrity across increasingly complex and diverse generative distortions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 44 of its 55 references that are in the map. First posted on arXiv 5 Mar 2026.
Builds on
44 of 55 references.
References · 44
- 2017Neural Discrete Representation Learningcited by 4,650
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
- 2022High Fidelity Neural Audio Compressioncited by 673
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2023Simple and Controllable Music Generationcited by 480
- 2023MusicLM: Generating Music From Textcited by 442
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2019Clotho: An Audio Captioning Datasetcited by 354
- 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 333
32 more
- 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 215
- 2024VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizerscited by 119
- 2024VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wildcited by 118
- 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 67
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 44
- 2024SNAC: Multi-Scale Neural Audio Codeccited by 42
- 2023WavMark: Watermarking for Audio Generationcited by 41
- 2023Detecting Voice Cloning Attacks via Timbre Watermarkingcited by 39
- 2024Attack-Resilient Image Watermarking Using Stable Diffusioncited by 33
- 2024A Transfer Attack to Image Watermarkscited by 26
- 2024AudioMarkBench: Benchmarking Robustness of Audio Watermarkingcited by 19
- 2024SilentCipher: Deep Audio Watermarkingcited by 15
- 2024Latent Watermarking of Audio Generative Modelscited by 12
- 2024Optimizing Adaptive Attacks against Watermarks for Language Modelscited by 11
- 2025VLA-Mark: A cross modal watermark for large vision-language alignment modelcited by 11
- 2025A Comprehensive Real-World Assessment of Audio Watermarking Algorithms: Will They Survive Neural Codecs?cited by 10
- 2025Deep Audio Watermarks are Shallow: Limitations of Post-Hoc Watermarking Techniques for Speechcited by 9
- 2025STAMP Your Content: Proving Dataset Membership via Watermarked Rephrasingscited by 8
- 2025SoK: How Robust is Audio Watermarking in Generative AI models?cited by 7
- 2022JaCappella Corpus: A Japanese a Cappella Vocal Ensemble Corpuscited by 4
- 2024WMCodec: End-to-End Neural Speech Codec with Deep Watermarking for Authenticity Verificationcited by 4
- 2025Bringing Interpretability to Neural Audio Codecscited by 4
- 2025Yours or Mine? Overwriting Attacks Against Neural Audio Watermarkingcited by 4
- 2026Self Voice Conversion as an Attack against Neural Audio Watermarkingcited by 4
- 2024Evaluating Durability: Benchmark Insights into Multimodal Watermarkingcited by 3
- 2024Noise-to-mask Ratio Loss for Deep Neural Network based Audio Watermarkingcited by 3
- 2024Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesiscited by 3
- 2025XAttnMark: Learning Robust Audio Watermarking with Cross-Attentioncited by 3
- 2025WaveVerify: A Novel Audio Watermarking Framework for Media Authentication and Combatting Deepfakescited by 3
- 2025Hashed Watermark as a Filter: Defeating Forging and Overwriting Attacks in Weight-based Neural Network Watermarkingcited by 2
- 2025Latent Granular Resynthesis using Neural Audio Codecscited by 2
- 2024SLIC: Secure Learned Image Codec through Compressed Domain Watermarking to Defend Image Manipulationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.