XAttnMark: Learning Robust Audio Watermarking with Cross-Attention
Not on the map. Why?
Abstract (arXiv)
The rapid proliferation of generative audio synthesis and editing technologies has raised serious concerns about copyright infringement, data provenance, and the spread of misinformation via deepfake audio. Watermarking offers a proactive solution by embedding imperceptible yet identifiable and traceable signals into audio content. While recent neural network-based watermarking methods like WavMark and AudioSeal have improved robustness and quality, they struggle to jointly optimize both robust detection and accurate attribution. This paper introduces Cross-Attention Robust Audio Watermark (XATTNMARK), which bridges this gap by leveraging partial parameter sharing between the generator and the detector, a cross-attention mechanism for efficient message retrieval, and a temporal conditioning module for improved message distribution. Additionally, we propose a psychoacoustic-aligned time-frequency (TF) masking loss that captures fine-grained auditory masking effects, improving watermark imperceptibility. XATTNMARK achieves state-of-the-art performance in both detection and attribution, demonstrating superior robustness against a wide range of audio transformations, including challenging generative editing at varying strengths. This work advances audio watermarking for protecting intellectual property and ensuring authenticity in the era of generative AI.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 39 of its 75 references that are in the map. First posted on arXiv 6 Feb 2025.
Builds on
39 of 75 references.
References · 39
- 2017Attention Is All You Needcited by 60,361
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2023Simple and Controllable Music Generationcited by 488
- 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 463
- 2023MusicLM: Generating Music From Textcited by 448
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 368
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 344
- 2019HopSkipJumpAttack: A Query-Efficient Decision-Based Attackcited by 333
- 2016FMA: A Dataset For Music Analysiscited by 207
27 more
- 2024Stable Audio Opencited by 197
- 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
- 2023On the Risk of Misinformation Pollution with Large Language Modelscited by 128
- 2019Imperceptible, Robust, and Targeted Adversarial Examples for Automatic Speech Recognitioncited by 124
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 121
- 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 78
- 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 60
- 2023WavMark: Watermarking for Audio Generationcited by 50
- 2023MetaCloak: Preventing Unauthorized Subject-driven Text-to-image Diffusion-based Synthesis via Meta-learningcited by 44
- 2023Detecting Voice Cloning Attacks via Timbre Watermarkingcited by 44
- 2024Copyright Protection in Generative AI: A Technical Perspectivecited by 38
- 2023Stable Unlearnable Example: Enhancing the Robustness of Unlearnable Examples via Stable Error-Minimizing Noisecited by 25
- 2024CodeIP: A Grammar-Guided Multi-Bit Watermark for Large Language Models of Codecited by 24
- 2024AudioMarkBench: Benchmarking Robustness of Audio Watermarkingcited by 23
- 2023Deepfakes, Misinformation, and Disinformation in the Era of Frontier AI, Generative AI, and Large AI Modelscited by 21
- 2024Exploring Musical Roots: Applying Audio Embeddings to Empower Influence Attribution for a Generative Music Modelcited by 13
- 2021"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real Worldcited by 12
- 2024Between Copyright and Computer Science: The Law and Ethics of Generative AIcited by 6
- 2020The Emerging Threats of Deepfake Attacks and Countermeasurescited by 5
- 2024"Violation of my body:" Perceptions of AI-generated non-consensual (intimate) imagerycited by 5
- 2023Hello Me, Meet the Real Me: Audio Deepfake Attacks on Voice Assistantscited by 3
- 2024Sound Check: Auditing Audio Datasetscited by 3
- 2020A Time-Frequency Perspective on Audio Watermarkingcited by 2
- 2022A Lattice-Based Embedding Method for Reversible Audio Watermarkingcited by 2
- 2017Robust Audio Watermarking Algorithm Based on Moving Average and DCTcited by 1
- 2020Selection of the optimal embedding positions of digital audio watermarking in wavelet domaincited by 1
- 2024Reporting Non-Consensual Intimate Media: An Audit Study of Deepfakescited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Self Voice Conversion as an Attack against Neural Audio Watermarkingcited by 4
- 2026Latent-Mark: An Audio Watermark Robust to Neural Codec Compressioncited by 1
- 2026MelShield: Robust Mel-Domain Audio Watermarking for Provenance Attribution of AI Generated Synthesized Speechcited by 1
- 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulationcited by 0
- 2026GAMW: Generation-Aware Mel-Domain Watermarking for TTS Traceabilitycited by 0
- 2026GAMW: Generation-Aware Mel-Domain Watermarking for TTS Traceability10 Oct 2026
- 2026MelShield: Robust Mel-Domain Audio Watermarking for Provenance Attribution of AI Generated Synthesized Speech2 May 2026
- 2026Latent-Mark: An Audio Watermark Robust to Neural Codec Compression5 Mar 2026
- 2026Self Voice Conversion as an Attack against Neural Audio Watermarking28 Jan 2026
- 2025Degrading Voice: A Comprehensive Overview of Robust Voice Conversion Through Input Manipulation6 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025AWARE: Audio Watermarking with Adversarial Resistance to Edits
- 2024SilentCipher: Deep Audio Watermarking
- 2025Multi-bit Audio Watermarking
- 2026CRAW: Codec Robust Audio Watermarking
- 2025A Comprehensive Real-World Assessment of Audio Watermarking Algorithms: Will They Survive Neural Codecs?
- 2025HarmonicAttack: An Adaptive Cross-Domain Audio Watermark Removal
- 2024IDEAW: Robust Neural Audio Watermarking with Invertible Dual-Embedding
- 2026Feature-Aligned Speech Watermarking for Robustness to Reconstruction Distortions