Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Data
Not on the map. Why?
Cited by 64 in LLM safety and security, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Photorealistic image generation has reached a new level of quality due to the breakthroughs of generative adversarial networks (GANs). Yet, the dark side of such deepfakes, the malicious use of generated media, raises concerns about visual misinformation. While existing research work on deepfake detection demonstrates high accuracy, it is subject to advances in generation techniques and adversarial iterations on detection countermeasure techniques. Thus, we seek a proactive and sustainable solution on deepfake detection, that is agnostic to the evolution of generative models, by introducing artificial fingerprints into the models. Our approach is simple and effective. We first embed artificial fingerprints into training data, then validate a surprising discovery on the transferability of such fingerprints from training data to generative models, which in turn appears in the generated deepfakes. Experiments show that our fingerprinting solution (1) holds for a variety of cutting-edge generative models, (2) leads to a negligible side effect on generation quality, (3) stays robust against image-level and model-level perturbations, (4) stays hard to be detected by adversaries, and (5) converts deepfake detection and attribution into trivial tasks and outperforms the recent state-of-the-art baselines. Our solution closes the responsibility loop between publishing pre-trained generative model inventions and their possible misuses, which makes it independent of the current arms race. Code and models are available at https://github.com/ningyu1991/ArtificialGANFingerprints .
Key facts. Cited by 200 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 15; 2023: 52; 2024: 57; 2025: 41; 2026: 26.
200 papers.
Sort:
By area:
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2022Perception Prioritized Training of Diffusion Modelscited by 301
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 289
- 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robustcited by 179
- 2023A Recipe for Watermarking Diffusion Modelscited by 136
- 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Modelscited by 131
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AIcited by 124
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 123
- 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 121
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
38 more
- 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 89
- 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 87
- 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Modelscited by 77
- 2021Multimodal Conditional Image Synthesis with Product-of-Experts GANscited by 75
- 2023Evading Watermark based Detection of AI-Generated Contentcited by 74
- 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
- 2022IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenescited by 62
- 2024R.A.C.E.: Robust Adversarial Concept Erasure for Secure Text-to-Image Diffusion Modelcited by 56
- 2023RoSteALS: Robust Steganography using Autoencoder Latent Spacecited by 54
- 2022DeepPrivacy2: Towards Realistic Full-Body Anonymizationcited by 51
- 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Modelscited by 51
- 2023Leveraging Optimization for Adaptive Attacks on Image Watermarkscited by 50
- 2024Watermark Anything with Localized Messagescited by 49
- 2024ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimizationcited by 45
- 2021Beyond the Spectrum: Detecting Deepfakes via Re-Synthesiscited by 44
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
- 2024AquaLoRA: Toward White-box Protection for Customized Stable Diffusion Models via Watermark LoRAcited by 42
- 2023DiffusionShield: A Watermark for Copyright Protection against Generative Diffusion Modelscited by 41
- 2022RepMix: Representation Mixing for Robust Attribution of Synthesized Imagescited by 39
- 2022Supervised GAN Watermarking for Intellectual Property Protectioncited by 39
- 2024Copyright Protection in Generative AI: A Technical Perspectivecited by 35
- 2023PTW: Pivotal Tuning Watermarking for Pre-Trained Image Generatorscited by 34
- 2023A Survey on ChatGPT: AI-Generated Contents, Challenges, and Solutionscited by 34
- 2024A Watermark-Conditioned Diffusion Model for IP Protectioncited by 34
- 2022StegaNeRF: Embedding Invisible Information within Neural Radiance Fieldscited by 32
- 2023Contrastive Pseudo Learning for Open-World DeepFake Attributioncited by 27
- 2023Nepotistically Trained Generative-AI Models Collapsecited by 27
- 2024LaWa: Using Latent Space for In-Generation Image Watermarkingcited by 27
- 2025SynthID-Image: Image watermarking at internet scalecited by 26
- 2024How to Trace Latent Generative Model Generated Images without Artificial Watermark?cited by 25
- 2024Watermark-embedded Adversarial Examples for Copyright Protection against Diffusion Modelscited by 22
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesiscited by 21
- 2024InvisMark: Invisible and Robust Watermarking for AI-generated Image Provenancecited by 21
- 2024LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarkscited by 21
- 2024Watermarking Techniques for Large Language Models: A Surveycited by 20
- 2024Latent Watermark: Inject and Detect Watermarks in Latent Diffusion Spacecited by 19
50 most cited of 200 All 200 (JSON)
- 2026WARP: A Unified Benchmark for Invisible Image Watermarking -- Robustness and Protection Against Attacks30 Sep 2026
- 2026Can Pixels Alone Reveal Image Origin? Minimax Limits and Learnable Interfaces for Passive Provenance25 Sep 2026
- 2026A Locally Tokenized Generative Model for Robust Time-Series Watermarking20 Aug 2026
- 2026IP Protection in the Era of Visual Generative AI: A Survey13 Aug 2026
- 2026Hybrid Semantic and Spectral Ensemble for Robust Synthetic Image Source Attribution24 Jul 2026
- 2026DNA: Dual-stage Native Attribution for Generated Image Source Tracing15 Jul 2026
- 2026TRACE: A Two-Channel Robust Attribution Watermark via Complementary Embeddings for LLM-Agent Trajectories9 Jul 2026
- 2026Data Provenance for Image Auto-Regressive Generation22 Jun 2026
- 2026FedOT: Ownership Verification and Leakage Tracing via Watermarks for Federated LDMs22 Jun 2026
- 2026Efficient, Robust, and Anti-Collusion Fingerprinting of Image Diffusion Models11 Jun 2026
- 2026Position: Preventing AI-Generated CSAM Necessitates New Approaches to AI Safety9 Jun 2026
- 2026Who Generated This 3D Asset? Learning Source Attribution for Generative 3D Models18 May 2026
38 more
- 2026GPT-Image-2 in the Wild: A Twitter Dataset of Self-Reported AI-Generated Images from the First Week of Deployment28 Apr 2026
- 2026Dual-Guard: Dual-Channel Latent Watermarking for Provenance and Tamper Localization in Diffusion Images21 Apr 2026
- 2026IncreFA: Breaking the Static Wall of Generative Model Attribution20 Apr 2026
- 2026SAiW: Source-Attributable Invisible Watermarking for Proactive Deepfake Defense24 Mar 2026
- 2026Rel-Zero: Harnessing Patch-Pair Invariance for Robust Zero-Watermarking Against AI Editing18 Mar 2026
- 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarking13 Mar 2026
- 2026Attribution as Retrieval: Model-Agnostic AI-Generated Image Attribution11 Mar 2026
- 2026Hide&Seek: Remove Image Watermarks with Negligible Cost via Pixel-wise Reconstruction1 Mar 2026
- 2026Q-Tag: Watermarking Quantum Circuit Generative Models26 Feb 2026
- 2026Towards Distillation-Resistant Large Language Models: An Information-Theoretic Perspective3 Feb 2026
- 2026ONRW: Optimizing inversion noise for high-quality and robust watermark24 Jan 2026
- 2026Decoder Gradient Shields: A Family of Provable and High-Fidelity Methods Against Gradient-Based Box-Free Watermark Removal17 Jan 2026
- 2026Identifying Models Behind Text-to-Image Leaderboards14 Jan 2026
- 2026Multi-Agent Framework for Controllable and Protected Generative Content Creation: Addressing Copyright and Provenance in AI-Generated Media9 Jan 2026
- 2025Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning14 Dec 2025
- 2025Authority Backdoor: A Certifiable Backdoor Mechanism for Authoring DNNs11 Dec 2025
- 2025Evaluating Dataset Watermarking for Fine-tuning Traceability of Customized Diffusion Models: A Comprehensive Benchmark and Removal Approach24 Nov 2025
- 2025Proto-LeakNet: Towards Signal-Leak Aware Attribution in Synthetic Human Face Imagery6 Nov 2025
- 2025NoisePrints: Distortion-Free Watermarks for Authorship in Private Diffusion Models15 Oct 2025
- 2025SynthID-Image: Image watermarking at internet scale10 Oct 2025
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Survey30 Sep 2025
- 2025MOLM: Mixture of LoRA Markers30 Sep 2025
- 2025Zero-Shot Visual Deepfake Detection: Can AI Predict and Prevent Fake Content Before It's Created?22 Sep 2025
- 2025PRISM: Phase-enhanced Radial-based Image Signature Mapping framework for fingerprinting AI-generated images18 Sep 2025
- 2025The Coding Limits of Robust Watermarking for Generative Models11 Sep 2025
- 2025Enhancing Robustness in Post-Processing Watermarking: An Ensemble Attack Network Using CNNs and Transformers3 Sep 2025
- 2025Uncovering and Mitigating Destructive Multi-Embedding Attacks in Deepfake Proactive Forensics24 Aug 2025
- 2025Learning Generalizable and Efficient Image Watermarking via Hierarchical Two-Stage Optimization12 Aug 2025
- 2025SPRINT: Robust Model Attribution of Generated Images via Secret Pixel Reconstruction6 Aug 2025
- 2025Untraceable DeepFakes via Traceable Fingerprint Elimination5 Aug 2025
- 2025Hot-Swap MarkBoard: An Efficient Black-box Watermarking Approach for Large-scale Model Distribution28 Jul 2025
- 2025AEDR: Training-Free AI-Generated Image Attribution via Autoencoder Double-Reconstruction25 Jul 2025
- 2025Traceable TTS: Toward Watermark-Free TTS with Strong Traceability5 Jul 2025
- 2025GaussMarker: Robust Dual-Domain Watermark for Diffusion Models13 Jun 2025
- 2025A Crack in the Bark: Leveraging Public Knowledge to Remove Tree-Ring Watermarks12 Jun 2025
- 2025Invisible Backdoor Triggers in Image Editing Model via Deep Watermarking5 Jun 2025
- 2025Modelship Attribution: Tracing Multi-Stage Manipulations Across Generative Models3 Jun 2025
- 2025Video Signature: Implicit Watermarking for Video Diffusion Models31 May 2025
50 newest of 200 All 200 (JSON)
- 2022Perception Prioritized Training of Diffusion Modelscited by 301
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Modelscited by 289
- 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robustcited by 179
- 2023A Recipe for Watermarking Diffusion Modelscited by 136
- 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Modelscited by 131
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 123
- 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion modelscited by 121
- 2024R.A.C.E.: Robust Adversarial Concept Erasure for Secure Text-to-Image Diffusion Modelcited by 56
- 2023WOUAF: Weight Modulation for User Attribution and Fingerprinting in Text-to-Image Diffusion Modelscited by 51
- 2024ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimizationcited by 45
- 2024AquaLoRA: Toward White-box Protection for Customized Stable Diffusion Models via Watermark LoRAcited by 42
- 2023DiffusionShield: A Watermark for Copyright Protection against Generative Diffusion Modelscited by 41
12 most cited of 51 All 51 (JSON)
- 2026DNA: Dual-stage Native Attribution for Generated Image Source Tracing15 Jul 2026
- 2026FedOT: Ownership Verification and Leakage Tracing via Watermarks for Federated LDMs22 Jun 2026
- 2026Efficient, Robust, and Anti-Collusion Fingerprinting of Image Diffusion Models11 Jun 2026
- 2026Dual-Guard: Dual-Channel Latent Watermarking for Provenance and Tamper Localization in Diffusion Images21 Apr 2026
- 2026Rel-Zero: Harnessing Patch-Pair Invariance for Robust Zero-Watermarking Against AI Editing18 Mar 2026
- 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarking13 Mar 2026
- 2026ONRW: Optimizing inversion noise for high-quality and robust watermark24 Jan 2026
- 2025Evaluating Dataset Watermarking for Fine-tuning Traceability of Customized Diffusion Models: A Comprehensive Benchmark and Removal Approach24 Nov 2025
- 2025NoisePrints: Distortion-Free Watermarks for Authorship in Private Diffusion Models15 Oct 2025
- 2025Zero-Shot Visual Deepfake Detection: Can AI Predict and Prevent Fake Content Before It's Created?22 Sep 2025
- 2025GaussMarker: Robust Dual-Domain Watermark for Diffusion Models13 Jun 2025
- 2025A Crack in the Bark: Leveraging Public Knowledge to Remove Tree-Ring Watermarks12 Jun 2025
12 newest of 51 All 51 (JSON)
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AIcited by 124
- 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Modelscited by 77
- 2023Evading Watermark based Detection of AI-Generated Contentcited by 74
- 2023RoSteALS: Robust Steganography using Autoencoder Latent Spacecited by 54
- 2023SepMark: Deep Separable Watermarking for Unified Source Tracing and Deepfake Detectioncited by 43
- 2023PTW: Pivotal Tuning Watermarking for Pre-Trained Image Generatorscited by 34
- 2024LaWa: Using Latent Space for In-Generation Image Watermarkingcited by 27
- 2023Generative Watermarking Against Unauthorized Subject-Driven Image Synthesiscited by 21
- 2024InvisMark: Invisible and Robust Watermarking for AI-generated Image Provenancecited by 21
- 2024LampMark: Proactive Deepfake Detection via Training-Free Landmark Perceptual Watermarkscited by 21
- 2024Watermarking Techniques for Large Language Models: A Surveycited by 20
- 2023Robust Identity Perceptual Watermark Against Deepfake Face Swappingcited by 17
12 most cited of 33 All 33 (JSON)
- 2026A Locally Tokenized Generative Model for Robust Time-Series Watermarking20 Aug 2026
- 2026Data Provenance for Image Auto-Regressive Generation22 Jun 2026
- 2026SAiW: Source-Attributable Invisible Watermarking for Proactive Deepfake Defense24 Mar 2026
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Survey30 Sep 2025
- 2025MOLM: Mixture of LoRA Markers30 Sep 2025
- 2025The Coding Limits of Robust Watermarking for Generative Models11 Sep 2025
- 2025Uncovering and Mitigating Destructive Multi-Embedding Attacks in Deepfake Proactive Forensics24 Aug 2025
- 2025Hot-Swap MarkBoard: An Efficient Black-box Watermarking Approach for Large-scale Model Distribution28 Jul 2025
- 2025KGMark: A Diffusion Watermark for Knowledge Graphs29 May 2025
- 2025Instance-Level Data-Use Auditing of Visual ML Models28 Mar 2025
- 2025Adoption of Watermarking for Generative AI Systems in Practice and Implications under the new EU AI Act23 Mar 2025
- 2025Safe-VAR: Safe Visual Autoregressive Model for Text-to-Image Generative Watermarking14 Mar 2025
12 newest of 33 All 33 (JSON)
- 2023Source Attribution for Large Language Model-Generated Datacited by 11
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 373
- 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2024WAVES: Benchmarking the Robustness of Image Watermarkscited by 89
- 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 87
- 2021Multimodal Conditional Image Synthesis with Product-of-Experts GANscited by 75
- 2024Proactive Detection of Voice Cloning with Localized Watermarkingcited by 67
- 2023BlendFace: Re-designing Identity Encoders for Face-Swappingcited by 66
- 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
- 2022IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenescited by 62
- 2022DeepPrivacy2: Towards Realistic Full-Body Anonymizationcited by 51
12 most cited of 113 All 113 (JSON)
- 2026WARP: A Unified Benchmark for Invisible Image Watermarking -- Robustness and Protection Against Attacks30 Sep 2026
- 2026Can Pixels Alone Reveal Image Origin? Minimax Limits and Learnable Interfaces for Passive Provenance25 Sep 2026
- 2026IP Protection in the Era of Visual Generative AI: A Survey13 Aug 2026
- 2026Hybrid Semantic and Spectral Ensemble for Robust Synthetic Image Source Attribution24 Jul 2026
- 2026Position: Preventing AI-Generated CSAM Necessitates New Approaches to AI Safety9 Jun 2026
- 2026Who Generated This 3D Asset? Learning Source Attribution for Generative 3D Models18 May 2026
- 2026GPT-Image-2 in the Wild: A Twitter Dataset of Self-Reported AI-Generated Images from the First Week of Deployment28 Apr 2026
- 2026IncreFA: Breaking the Static Wall of Generative Model Attribution20 Apr 2026
- 2026Attribution as Retrieval: Model-Agnostic AI-Generated Image Attribution11 Mar 2026
- 2026Hide&Seek: Remove Image Watermarks with Negligible Cost via Pixel-wise Reconstruction1 Mar 2026
- 2026Q-Tag: Watermarking Quantum Circuit Generative Models26 Feb 2026
- 2026Towards Distillation-Resistant Large Language Models: An Information-Theoretic Perspective3 Feb 2026
12 newest of 113 All 113 (JSON)