Beyond AI-Generated Labels: Watermarking, Co-Creation, and Conflation of AI-Generation with Disinformation
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Watermarking is often presented as a straightforward solution for distinguishing AI-generated from human-generated content, enabling platforms and regulators to trace synthetic content and detect AI-generated outputs at scale. This paper examines whether such mechanisms meaningfully address the epistemic and ethical challenges that arise in domains where the central concern is not the automation of content production, but the accuracy, intent, and deceptive potential of messages. We argue that extending watermark-based approaches to these settings is conceptually and practically misguided. Invisible watermarking encodes only model origin; when operationalized into visible AI-generated labels, it reduces complex creative processes to a misleading binary and provides no information about truthfulness. Such labels may stigmatize legitimate uses of generative tools while encouraging misplaced trust in unmarked content. Here we propose an alternative approach centered on process transparency and information literacy. We argue that these measures address the epistemic and ethical dimensions of AI-generated disinformation more effectively than visible watermark labels, reframing authorship as a transparent human practice rather than a binary indicator of machine involvement.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 13 of its 44 references that are in the map. First posted on arXiv 13 Jul 2026.
Builds on
13 of 44 references.
Closest ancestors · 8
Same direction, newest first
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks5 Nov
- 2025Revealing Weaknesses in Text Watermarking Through Self-Information Rewrite Attacks8 May
- 2024InvisMark: Invisible and Robust Watermarking for AI-generated Image Provenance10 Nov
- 2024Provably Robust Multi-bit Watermarking for AI-generated Text30 Jan
- 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attacks29 Sep
- 2023Warfare:Breaking the Watermark Protection of AI-Generated Content27 Sep
- 2023Watermarking Conditional Text Generation for AI Detection: Unveiling Challenges and a Semantic-Aware Watermark Remedy25 Jul
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun
Other references · 5
- 2023AI model GPT-3 (dis)informs us better than humanscited by 78
- 2025SynthID-Image: Image watermarking at internet scalecited by 31
- 2024Revisiting the Robustness of Watermarking to Paraphrasing Attackscited by 25
- 2025WMCopier: Forging Invisible Image Watermarks on Arbitrary Imagescited by 6
- 2025Sandcastles in the Storm: Revisiting the (Im)possibility of Strong Watermarkingcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Forensics to Ecosystems: Rethinking Watermarks for Generative AI Oversight
- 2026Understanding Security and Privacy Perceptions of Content Creators Regarding AI Labels of AI-Generated Content
- 2026Who Gets Flagged? The Pluralistic Evaluation Gap in AI Content Watermarking
- 2026"AI Watermarking": Bridging Policy Discourse and Technical Capabilities
- 2025Watermarking Without Standards Is Not AI Governance
- 2022The Ethical Need for Watermarks in Machine-Generated Language
- 2026Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 II
- 2025Adoption of Watermarking for Generative AI Systems in Practice and Implications under the new EU AI Act