mlsanityData to 14 Oct 2026

Combining Self-Embedding Audio Watermarking with Ultra-Low-Bitrate Neural Codecs

arXiv 2608.25289 ↗First posted 26 Aug 2026cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Partial manipulation of speech recordings, where only localized segments of an utterance are altered, poses a significant challenge for content integrity verification, as reliable detection and localization of such edits becomes harder as the manipulated proportion decreases. Watermarking offers a proactive defense alternative by embedding auxiliary information prior to distribution; classical hash-based schemes achieve near-perfect detection and localization under ideal conditions, but the original content cannot be recovered once a segment is manipulated. Building on a prior self-embedding audio steganography framework, this work presents an initial exploration of proactive defense performance under ideal conditions, extending the investigation along three axes: frame-level localization, multi-bit least significant bit variants, and evaluation across multiple ultra-low-bitrate neural codec representations. By embedding a compact neural codec representation rather than a cryptographic hash, the framework additionally enables recovery of the manipulated regions, while supporting training-free detection and localization without spoofed examples. Experiments across four controlled manipulation types under ideal channel conditions show that the embedded payload, and hence an approximate reconstruction of the authentic content, is always fully recovered without bit errors. The results also indicate that the choice of neural codec is the dominant factor for detection and localization performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 31 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

14 of 31 references.

References · 14

  1. 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
  2. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
  3. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  4. 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 440
  5. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 278
  6. 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
  7. 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 78
  8. 2024Scaling Transformers for Low-Bitrate High-Quality Speech Codingcited by 49
  9. 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
  10. 2024SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Soundcited by 45
  11. 2023Detecting Voice Cloning Attacks via Timbre Watermarkingcited by 44
  12. 2024SNAC: Multi-Scale Neural Audio Codeccited by 43
2 more
  1. 2025Discrete Audio Tokens: More Than a Survey!cited by 38
  2. 2025Manipulated Regions Localization For Partially Deepfake Audio: A Surveycited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Latent-Mark: An Audio Watermark Robust to Neural Codec Compression
  2. 2024Audio Codec Augmentation for Robust Collaborative Watermarking of Speech Synthesis
  3. 2024IDEAW: Robust Neural Audio Watermarking with Invertible Dual-Embedding
  4. 2025AWARE: Audio Watermarking with Adversarial Resistance to Edits
  5. 2026Feature-Aligned Speech Watermarking for Robustness to Reconstruction Distortions
  6. 2026Self Voice Conversion as an Attack against Neural Audio Watermarking
  7. 2026CRAW: Codec Robust Audio Watermarking
  8. 2025Multi-bit Audio Watermarking