mlsanityData to 14 Oct 2026

XAttnMark: Learning Robust Audio Watermarking with Cross-Attention

arXiv 2502.04230 ↗First posted 6 Feb 2025cs.SD cs.AI cs.CRcited by 5

Not on the map. Why?

Abstract (arXiv)

The rapid proliferation of generative audio synthesis and editing technologies has raised serious concerns about copyright infringement, data provenance, and the spread of misinformation via deepfake audio. Watermarking offers a proactive solution by embedding imperceptible yet identifiable and traceable signals into audio content. While recent neural network-based watermarking methods like WavMark and AudioSeal have improved robustness and quality, they struggle to jointly optimize both robust detection and accurate attribution. This paper introduces Cross-Attention Robust Audio Watermark (XATTNMARK), which bridges this gap by leveraging partial parameter sharing between the generator and the detector, a cross-attention mechanism for efficient message retrieval, and a temporal conditioning module for improved message distribution. Additionally, we propose a psychoacoustic-aligned time-frequency (TF) masking loss that captures fine-grained auditory masking effects, improving watermark imperceptibility. XATTNMARK achieves state-of-the-art performance in both detection and attribution, demonstrating superior robustness against a wide range of audio transformations, including challenging generative editing at varying strengths. This work advances audio watermarking for protecting intellectual property and ensuring authenticity in the era of generative AI.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 39 of its 75 references that are in the map. First posted on arXiv 6 Feb 2025.

Builds on

39 of 75 references.

References · 39

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  4. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
  5. 2022High Fidelity Neural Audio Compressioncited by 687
  6. 2023Simple and Controllable Music Generationcited by 488
  7. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 463
  8. 2023MusicLM: Generating Music From Textcited by 448
  9. 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 368
  10. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 344
  11. 2019HopSkipJumpAttack: A Query-Efficient Decision-Based Attackcited by 333
  12. 2016FMA: A Dataset For Music Analysiscited by 207
27 more
  1. 2024Stable Audio Opencited by 197
  2. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 188
  3. 2023On the Risk of Misinformation Pollution with Large Language Modelscited by 128
  4. 2019Imperceptible, Robust, and Targeted Adversarial Examples for Automatic Speech Recognitioncited by 124
  5. 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 121
  6. 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 78
  7. 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 60
  8. 2023WavMark: Watermarking for Audio Generationcited by 50
  9. 2023MetaCloak: Preventing Unauthorized Subject-driven Text-to-image Diffusion-based Synthesis via Meta-learningcited by 44
  10. 2023Detecting Voice Cloning Attacks via Timbre Watermarkingcited by 44
  11. 2024Copyright Protection in Generative AI: A Technical Perspectivecited by 38
  12. 2023Stable Unlearnable Example: Enhancing the Robustness of Unlearnable Examples via Stable Error-Minimizing Noisecited by 25
  13. 2024CodeIP: A Grammar-Guided Multi-Bit Watermark for Large Language Models of Codecited by 24
  14. 2024AudioMarkBench: Benchmarking Robustness of Audio Watermarkingcited by 23
  15. 2023Deepfakes, Misinformation, and Disinformation in the Era of Frontier AI, Generative AI, and Large AI Modelscited by 21
  16. 2024Exploring Musical Roots: Applying Audio Embeddings to Empower Influence Attribution for a Generative Music Modelcited by 13
  17. 2021"Hello, It's Me": Deep Learning-based Speech Synthesis Attacks in the Real Worldcited by 12
  18. 2024Between Copyright and Computer Science: The Law and Ethics of Generative AIcited by 6
  19. 2020The Emerging Threats of Deepfake Attacks and Countermeasurescited by 5
  20. 2024"Violation of my body:" Perceptions of AI-generated non-consensual (intimate) imagerycited by 5
  21. 2023Hello Me, Meet the Real Me: Audio Deepfake Attacks on Voice Assistantscited by 3
  22. 2024Sound Check: Auditing Audio Datasetscited by 3
  23. 2020A Time-Frequency Perspective on Audio Watermarkingcited by 2
  24. 2022A Lattice-Based Embedding Method for Reversible Audio Watermarkingcited by 2
  25. 2017Robust Audio Watermarking Algorithm Based on Moving Average and DCTcited by 1
  26. 2020Selection of the optimal embedding positions of digital audio watermarking in wavelet domaincited by 1
  27. 2024Reporting Non-Consensual Intimate Media: An Audit Study of Deepfakescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AWARE: Audio Watermarking with Adversarial Resistance to Edits
  2. 2024SilentCipher: Deep Audio Watermarking
  3. 2025Multi-bit Audio Watermarking
  4. 2026CRAW: Codec Robust Audio Watermarking
  5. 2025A Comprehensive Real-World Assessment of Audio Watermarking Algorithms: Will They Survive Neural Codecs?
  6. 2025HarmonicAttack: An Adaptive Cross-Domain Audio Watermark Removal
  7. 2024IDEAW: Robust Neural Audio Watermarking with Invertible Dual-Embedding
  8. 2026Feature-Aligned Speech Watermarking for Robustness to Reconstruction Distortions