TriniMark: A Robust Generative Speech Watermarking Method for Trinity-Level Traceability
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Diffusion-based speech generation has achieved remarkable fidelity, increasing the risk of misuse and unauthorized redistribution. However, most existing generative speech watermarking methods are developed for GAN-based pipelines, and watermarking for diffusion-based speech generation remains comparatively underexplored. In addition, prior work often focuses on content-level provenance, while support for model-level and user-level attribution is less mature. We propose TriniMark, a diffusion-based generative speech watermarking framework that targets trinity-level traceability, i.e., the ability to associate a generated speech sample with (i) the embedded watermark message (content-level provenance), (ii) the source generative model (model-level attribution), and (iii) the end user who requested generation (user-level traceability). TriniMark uses a lightweight encoder to embed watermark bits into time-domain speech features and reconstruct the waveform, and a temporal-aware gated convolutional decoder for reliable bit recovery. We further introduce a waveform-guided fine-tuning strategy to transfer watermarking capability into a diffusion model. Finally, we incorporate variable-watermark training so that a single trained model can embed different watermark messages at inference time, enabling scalable user-level traceability. Experiments on speech datasets indicate that TriniMark maintains speech quality while improving robustness to common single and compound signal-processing attacks, and it supports high-capacity watermarking for large-scale traceability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 26 of its 49 references that are in the map. First posted on arXiv 29 Apr 2025.
Builds on
26 of 49 references.
Closest ancestors · 2
Same direction, newest first
- 2024GROOT: Generating Robust Watermark for Diffusion-Model-Based Audio Synthesis15 Jul
- 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
Other references · 24
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
- 2016Language Modeling with Gated Convolutional Networkscited by 702
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 649
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
- 2018HiDDeN: Hiding Data With Deep Networkscited by 397
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 265
- 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 201
12 more
- 2021PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Priorcited by 80
- 2021A survey of deep neural network watermarking techniquescited by 73
- 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
- 2023Detecting Voice Cloning Attacks via Timbre Watermarkingcited by 44
- 2022DeAR: A Deep-learning-based Audio Re-recording Resilient Watermarkingcited by 22
- 2024ProMark: Proactive Diffusion Watermarking for Causal Attributioncited by 17
- 2024Latent Watermarking of Audio Generative Modelscited by 16
- 2023Collaborative Watermarking for Adversarial Speech Synthesiscited by 7
- 2024TraceableSpeech: Towards Proactively Traceable Text-to-Speech with Watermarkingcited by 7
- 2022Attributable-Watermarking of Speech Generative Modelscited by 5
- 2022CycleGANWM: A CycleGAN watermarking method for ownership verificationcited by 5
- 2022Mixer: DNN Watermarking using Image Mixupcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SOLIDO: A Robust Watermarking Method for Speech Synthesis via Low-Rank Adaptation
- 2026GAMW: Generation-Aware Mel-Domain Watermarking for TTS Traceability
- 2026VocBulwark: Towards Practical Generative Speech Watermarking via Additional-Parameter Injection
- 2025Traceable TTS: Toward Watermark-Free TTS with Strong Traceability
- 2025Protecting Your Voice: Temporal-aware Robust Watermarking
- 2026MelShield: Robust Mel-Domain Audio Watermarking for Provenance Attribution of AI Generated Synthesized Speech
- 2026Hidden in Plain Tokens: Simply Robust, Gradient-Free Watermark for Synthetic Audio
- 2026MusicMark: A Robust Generative Watermarking Framework for Music Generation