GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesis
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Amid the burgeoning development of generative models like diffusion models, the task of differentiating synthesized audio from its natural counterpart grows more daunting. Deepfake detection offers a viable solution to combat this challenge. Yet, this defensive measure unintentionally fuels the continued refinement of generative models. Watermarking emerges as a proactive and sustainable tactic, preemptively regulating the creation and dissemination of synthesized content. Thus, this paper, as a pioneer, proposes the generative robust audio watermarking method (Groot), presenting a paradigm for proactively supervising the synthesized audio and its source diffusion models. In this paradigm, the processes of watermark generation and audio synthesis occur simultaneously, facilitated by parameter-fixed diffusion models equipped with a dedicated encoder. The watermark embedded within the audio can subsequently be retrieved by a lightweight decoder. The experimental results highlight Groot's outstanding performance, particularly in terms of robustness, surpassing that of the leading state-of-the-art methods. Beyond its impressive resilience against individual post-processing attacks, Groot exhibits exceptional robustness when facing compound attacks, maintaining an average watermark extraction accuracy of around 95%.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 27 of its 42 references that are in the map. First posted on arXiv 15 Jul 2024.
Builds on
27 of 42 references.
References · 27
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2016Language Modeling with Gated Convolutional Networkscited by 688
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
15 more
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 200
- 2022ProDiff: Progressive Fast Diffusion Model For High-Quality Text-to-Speechcited by 147
- 2020AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselinescited by 111
- 2020Responsible Disclosure of Generative Models Using Scalable Fingerprintingcited by 90
- 2021PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Priorcited by 78
- 2021A survey of deep neural network watermarking techniquescited by 69
- 2022BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesiscited by 64
- 2021Deep Model Intellectual Property Protection via Deep Watermarkingcited by 47
- 2021Protecting Intellectual Property of Generative Adversarial Networks from Ambiguity Attackcited by 45
- 2023Detecting Voice Cloning Attacks via Timbre Watermarkingcited by 39
- 2022DeAR: A Deep-learning-based Audio Re-recording Resilient Watermarkingcited by 15
- 2023Copyright Protection and Accountability of Generative AI:Attack, Watermarking and Attributioncited by 15
- 2023LightGrad: Lightweight Diffusion Probabilistic Model for Text-to-Speechcited by 13
- 2024GLA-Grad: A Griffin-Lim Extended Waveform Generation Diffusion Modelcited by 6
- 2022CycleGANWM: A CycleGAN watermarking method for ownership verificationcited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 9; 2026: 7.
17 papers.
Sort:
By area:
- 2024SoK: Watermarking for AI-Generated Contentcited by 43
- 2025Weakly-supervised Audio Temporal Forgery Localization via Progressive Audio-language Co-learning Networkcited by 6
- 2026Self Voice Conversion as an Attack against Neural Audio Watermarkingcited by 4
- 2026SCMAPR: Self-Correcting Multi-Agent Prompt Refinement for Complex-Scenario Text-to-Video Generationcited by 4
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Modelscited by 3
- 2025De-AntiFake: Rethinking the Protective Perturbations Against Voice Cloning Attackscited by 2
- 2025HarmonicAttack: An Adaptive Cross-Domain Audio Watermark Removalcited by 2
- 2025Traceable TTS: Toward Watermark-Free TTS with Strong Traceabilitycited by 1
- 2026CRAW: Codec Robust Audio Watermarkingcited by 1
- 2025Protecting Your Voice: Temporal-aware Robust Watermarkingcited by 0
- 2025SOLIDO: A Robust Watermarking Method for Speech Synthesis via Low-Rank Adaptationcited by 0
- 2025TriniMark: A Robust Generative Speech Watermarking Method for Trinity-Level Traceabilitycited by 0
5 more
- 2025UniMark: Artificial Intelligence Generated Content Identification Toolkitcited by 0
- 2025Smark: A Watermark for Text-to-Speech Diffusion Models via Discrete Wavelet Transformcited by 0
- 2026LambdaMark: Semantic Audio Watermarking for Robustness and Radioactivitycited by 0
- 2026MusicMark: A Robust Generative Watermarking Framework for Music Generationcited by 0
- 2026AudioNoisePrints: Model-free audio watermarking using spatial correlation in flow matching TTScited by 0
- 2026CRAW: Codec Robust Audio Watermarking2 Sep 2026
- 2026AudioNoisePrints: Model-free audio watermarking using spatial correlation in flow matching TTS23 Aug 2026
- 2026MusicMark: A Robust Generative Watermarking Framework for Music Generation13 Jul 2026
- 2026LambdaMark: Semantic Audio Watermarking for Robustness and Radioactivity19 Jun 2026
- 2026SCMAPR: Self-Correcting Multi-Agent Prompt Refinement for Complex-Scenario Text-to-Video Generation7 Apr 2026
- 2026Self Voice Conversion as an Attack against Neural Audio Watermarking28 Jan 2026
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Models27 Jan 2026
- 2025Smark: A Watermark for Text-to-Speech Diffusion Models via Discrete Wavelet Transform21 Dec 2025
- 2025UniMark: Artificial Intelligence Generated Content Identification Toolkit13 Dec 2025
- 2025HarmonicAttack: An Adaptive Cross-Domain Audio Watermark Removal26 Nov 2025
- 2025Traceable TTS: Toward Watermark-Free TTS with Strong Traceability5 Jul 2025
- 2025De-AntiFake: Rethinking the Protective Perturbations Against Voice Cloning Attacks3 Jul 2025
5 more
- 2025Weakly-supervised Audio Temporal Forgery Localization via Progressive Audio-language Co-learning Network3 May 2025
- 2025TriniMark: A Robust Generative Speech Watermarking Method for Trinity-Level Traceability29 Apr 2025
- 2025SOLIDO: A Robust Watermarking Method for Speech Synthesis via Low-Rank Adaptation21 Apr 2025
- 2025Protecting Your Voice: Temporal-aware Robust Watermarking21 Apr 2025
- 2024SoK: Watermarking for AI-Generated Content27 Nov 2024
- 2026SCMAPR: Self-Correcting Multi-Agent Prompt Refinement for Complex-Scenario Text-to-Video Generationcited by 4
- 2025SOLIDO: A Robust Watermarking Method for Speech Synthesis via Low-Rank Adaptationcited by 0
- 2025TriniMark: A Robust Generative Speech Watermarking Method for Trinity-Level Traceabilitycited by 0
- 2025Smark: A Watermark for Text-to-Speech Diffusion Models via Discrete Wavelet Transformcited by 0
- 2026AudioNoisePrints: Model-free audio watermarking using spatial correlation in flow matching TTScited by 0
- 2026AudioNoisePrints: Model-free audio watermarking using spatial correlation in flow matching TTS23 Aug 2026
- 2026SCMAPR: Self-Correcting Multi-Agent Prompt Refinement for Complex-Scenario Text-to-Video Generation7 Apr 2026
- 2025Smark: A Watermark for Text-to-Speech Diffusion Models via Discrete Wavelet Transform21 Dec 2025
- 2025TriniMark: A Robust Generative Speech Watermarking Method for Trinity-Level Traceability29 Apr 2025
- 2025SOLIDO: A Robust Watermarking Method for Speech Synthesis via Low-Rank Adaptation21 Apr 2025
- 2024SoK: Watermarking for AI-Generated Contentcited by 43
- 2026MusicMark: A Robust Generative Watermarking Framework for Music Generationcited by 0
- 2026MusicMark: A Robust Generative Watermarking Framework for Music Generation13 Jul 2026
- 2024SoK: Watermarking for AI-Generated Content27 Nov 2024
- 2025Weakly-supervised Audio Temporal Forgery Localization via Progressive Audio-language Co-learning Networkcited by 6
- 2026Self Voice Conversion as an Attack against Neural Audio Watermarkingcited by 4
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Modelscited by 3
- 2025De-AntiFake: Rethinking the Protective Perturbations Against Voice Cloning Attackscited by 2
- 2025HarmonicAttack: An Adaptive Cross-Domain Audio Watermark Removalcited by 2
- 2025Traceable TTS: Toward Watermark-Free TTS with Strong Traceabilitycited by 1
- 2026CRAW: Codec Robust Audio Watermarkingcited by 1
- 2025Protecting Your Voice: Temporal-aware Robust Watermarkingcited by 0
- 2025UniMark: Artificial Intelligence Generated Content Identification Toolkitcited by 0
- 2026LambdaMark: Semantic Audio Watermarking for Robustness and Radioactivitycited by 0
- 2026CRAW: Codec Robust Audio Watermarking2 Sep 2026
- 2026LambdaMark: Semantic Audio Watermarking for Robustness and Radioactivity19 Jun 2026
- 2026Self Voice Conversion as an Attack against Neural Audio Watermarking28 Jan 2026
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Models27 Jan 2026
- 2025UniMark: Artificial Intelligence Generated Content Identification Toolkit13 Dec 2025
- 2025HarmonicAttack: An Adaptive Cross-Domain Audio Watermark Removal26 Nov 2025
- 2025Traceable TTS: Toward Watermark-Free TTS with Strong Traceability5 Jul 2025
- 2025De-AntiFake: Rethinking the Protective Perturbations Against Voice Cloning Attacks3 Jul 2025
- 2025Weakly-supervised Audio Temporal Forgery Localization via Progressive Audio-language Co-learning Network3 May 2025
- 2025Protecting Your Voice: Temporal-aware Robust Watermarking21 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2023Invisible Watermarking for Audio Generation Diffusion Models
- 2026ShapeMark: Robust and Diversity-Preserving Watermarking for Diffusion Models
- 2026Audio Pirates: Black-box Audio Watermark Removal via Diffusion Priors
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation
- 2024Hidden in the Noise: Two-Stage Robust Watermarking for Images
- 2025T2SMark: Balancing Robustness and Diversity in Noise-as-Watermark for Diffusion Models
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks
- 2025Visual Watermarking in the Era of Diffusion Models: Advances and Challenges