DeepfakeArt Challenge: A Benchmark Dataset for Generative AI Art Forgery and Data Poisoning Detection
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
The tremendous recent advances in generative artificial intelligence techniques have led to significant successes and promise in a wide range of different applications ranging from conversational agents and textual content generation to voice and visual synthesis. Amid the rise in generative AI and its increasing widespread adoption, there has been significant growing concern over the use of generative AI for malicious purposes. In the realm of visual content synthesis using generative AI, key areas of significant concern has been image forgery (e.g., generation of images containing or derived from copyright content), and data poisoning (i.e., generation of adversarially contaminated images). Motivated to address these key concerns to encourage responsible generative AI, we introduce the DeepfakeArt Challenge, a large-scale challenge benchmark dataset designed specifically to aid in the building of machine learning algorithms for generative AI art forgery and data poisoning detection. Comprising of over 32,000 records across a variety of generative forgery and data poisoning techniques, each entry consists of a pair of images that are either forgeries / adversarially contaminated or not. Each of the generated images in the DeepfakeArt Challenge benchmark dataset footnoteThe link to the dataset: http://anonforreview.com has been quality checked in a comprehensive manner.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 23 of its 38 references that are in the map. First posted on arXiv 2 Jun 2023.
Builds on
23 of 38 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
11 more
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
- 2022Quantifying Memorization Across Neural Language Modelscited by 755
- 2020RobustBench: a standardized adversarial robustness benchmarkcited by 659
- 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2015Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Featurecited by 181
- 2020Torchattacks: A PyTorch Repository for Adversarial Attackscited by 156
- 2023Emergent and Predictable Memorization in Large Language Modelscited by 147
- 2019MultiGrain: a unified image embedding for classes and instancescited by 85
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 2.
9 papers.
- 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11
- 2024MAGID: An Automated Pipeline for Generating Synthetic Multi-modal Datasetscited by 10
- 2023VA3: Virtually Assured Amplification Attack on Probabilistic Copyright Protection for Text-to-Image Generative Modelscited by 5
- 2024The last Dance : Robust backdoor attack via diffusion models and bayesian approachcited by 3
- 2024Unveiling the Truth: Exploring Human Gaze Patterns in Fake Imagescited by 3
- 2024LookupForensics: A Large-Scale Multi-Task Dataset for Multi-Phase Image-Based Fact Verificationcited by 2
- 2024Uncertain Boundaries: Multidisciplinary Approaches to Copyright Issues in Generative AIcited by 1
- 2025UniAIDet: A Unified and Universal Benchmark for AI-Generated Image Content Detection and Localizationcited by 1
- 2025DFA-CON: A Contrastive Learning Approach for Detecting Copyright Infringement in DeepFake Artcited by 0
- 2025UniAIDet: A Unified and Universal Benchmark for AI-Generated Image Content Detection and Localization27 Oct 2025
- 2025DFA-CON: A Contrastive Learning Approach for Detecting Copyright Infringement in DeepFake Art13 May 2025
- 2024LookupForensics: A Large-Scale Multi-Task Dataset for Multi-Phase Image-Based Fact Verification26 Jul 2024
- 2024Replication in Visual Diffusion Models: A Survey and Outlook7 Jul 2024
- 2024Uncertain Boundaries: Multidisciplinary Approaches to Copyright Issues in Generative AI31 Mar 2024
- 2024Unveiling the Truth: Exploring Human Gaze Patterns in Fake Images13 Mar 2024
- 2024MAGID: An Automated Pipeline for Generating Synthetic Multi-modal Datasets5 Mar 2024
- 2024The last Dance : Robust backdoor attack via diffusion models and bayesian approach5 Feb 2024
- 2023VA3: Virtually Assured Amplification Attack on Probabilistic Copyright Protection for Text-to-Image Generative Models29 Nov 2023