Detecting Generative Parroting through Overfitting Masked Autoencoders
Not on the map. Why?
Abstract (arXiv)
The advent of generative AI models has revolutionized digital content creation, yet it introduces challenges in maintaining copyright integrity due to generative parroting, where models mimic their training data too closely. Our research presents a novel approach to tackle this issue by employing an overfitted Masked Autoencoder (MAE) to detect such parroted samples effectively. We establish a detection threshold based on the mean loss across the training dataset, allowing for the precise identification of parroted content in modified datasets. Preliminary evaluations demonstrate promising results, suggesting our method's potential to ensure ethical use and enhance the legal compliance of generative models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 14 of its 21 references that are in the map. First posted on arXiv 27 Mar 2024.
Builds on
14 of 21 references.
References · 14
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022Quantifying Memorization Across Neural Language Modelscited by 755
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2023On Provable Copyright Protection for Generative Modelscited by 97
- 2023Hierarchical Neural Coding for Controllable CAD Model Generationcited by 84
- 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 78
- 2020SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Designcited by 72
- 2020A Non-Parametric Test to Detect Data-Copying in Generative Modelscited by 52
- 2021Engineering Sketch Generation for Computer-Aided Designcited by 49
2 more
- 2020Towards GAN Benchmarks Which Require Generalizationcited by 31
- 2021Copyright in Generative Deep Learningcited by 29
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024Replication in Visual Diffusion Models: A Survey and Outlookcited by 11