mlsanityData to 14 Oct 2026

Detecting Origin Attribution for Text-to-Image Diffusion Models

arXiv 2403.19653 ↗First posted 28 Mar 2024cs.CVcited by 7

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Modern text-to-image (T2I) diffusion models can generate images with remarkable realism and creativity. These advancements have sparked research in fake image detection and attribution, yet prior studies have not fully explored the practical and scientific dimensions of this task. In addition to attributing images to 12 state-of-the-art T2I generators, we provide extensive analyses on what inference stage hyperparameters and image modifications are discernible. Our experiments reveal that initialization seeds are highly detectable, along with other subtle variations in the image generation process to some extent. We further investigate what visual traces are leveraged in image attribution by perturbing high-frequency details and employing mid-level representations of image style and structure. Notably, altering high-frequency information causes only slight reductions in accuracy, and training an attributor on style representations outperforms training on RGB images. Our analyses underscore that fake images are detectable and attributable at various levels of visual granularity.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 58 of its 84 references that are in the map. First posted on arXiv 28 Mar 2024.

Builds on

58 of 84 references.

Closest ancestors · 10

Same direction, newest first

  1. 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusion5 Oct
  2. 2023Wuerstchen: An Efficient Architecture for Large-Scale Text-to-Image Diffusion Models1 Jun
  3. 2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learning23 May
  4. 2023Intriguing properties of synthetic images: from generative adversarial networks to diffusion models13 Apr
  5. 2023Parents and Children: Distinguishing Multimodal DeepFakes from Natural Images2 Apr
  6. 2023Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Models1 Mar
  7. 2022On the detection of synthetic images generated by diffusion models1 Nov
  8. 2022Towards the Detection of Diffusion Model Deepfakes26 Oct
  9. 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Models13 Oct
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  7. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  8. 2020Denoising Diffusion Implicit Modelscited by 9,781
  9. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  10. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  12. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
36 more
  1. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  2. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  3. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  4. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  5. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  6. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  7. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  8. 2023Adversarial Diffusion Distillationcited by 759
  9. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  10. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  11. 2018Learning to See in the Darkcited by 460
  12. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
  13. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
  14. 2020What makes fake images detectable? Understanding properties that generalizecited by 273
  15. 2022EfficientFormer: Vision Transformers at MobileNet Speedcited by 241
  16. 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
  17. 2020Artificial Fingerprinting for Generative Models: Rooting Deepfake Attribution in Training Datacited by 201
  18. 2023Raising the Bar of AI-generated Image Detection with CLIPcited by 164
  19. 2019Fourier Spectrum Discrepancies in Deep Network Generated Imagescited by 139
  20. 2021Are GAN generated images easy to detect? A critical analysis of the state-of-the-artcited by 139
  21. 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
  22. 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
  23. 2023CIFAKE: Image Classification and Explainable Identification of AI-Generated Synthetic Imagescited by 84
  24. 2022Perspective Fields for Single Image Camera Calibrationcited by 75
  25. 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
  26. 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
  27. 2019Incremental learning for the detection and classification of GAN-generated imagescited by 58
  28. 2023Online Detection of AI-Generated Imagescited by 55
  29. 2023Generative Models: What Do They Know? Do They Know Things? Let's Find Out!cited by 50
  30. 2024A Single Simple Patch is All You Need for AI-generated Image Detectioncited by 44
  31. 2022RepMix: Representation Mixing for Robust Attribution of Synthesized Imagescited by 39
  32. 2023GenDet: Towards Good Generalizations for AI-Generated Image Detectioncited by 36
  33. 2023Beyond Surface Statistics: Scene Representations in a Latent Diffusion Modelcited by 30
  34. 2023Diffusion Noise Feature: Accurate and Fast Generated Image Detectioncited by 21
  35. 2024Organic or Diffused: Can We Distinguish Human Art from AI-generated Images?cited by 21
  36. 2023Single-Model Attribution of Generative Models Through Final-Layer Inversioncited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 5.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024FakeInversion: Learning to Detect Images from Unseen Text-to-Image Models by Inverting Stable Diffusion
  2. 2024Image-Perfect Imperfections: Safety, Bias, and Authenticity in the Shadow of Text-To-Image Model Evolution
  3. 2025Characterizing Photorealism and Artifacts in Diffusion Model-Generated Images
  4. 2023Diversity and Diffusion: Observations on Synthetic Image Distributions with Stable Diffusion
  5. 2026When Pretty Isn't Useful: Investigating Why Modern Text-to-Image Models Fail as Reliable Training Data Generators
  6. 2025Concept-TRAK: Understanding how diffusion models learn concepts through concept-level attribution
  7. 2025Who Made This? Fake Detection and Source Attribution with Diffusion Features
  8. 2024Good Seed Makes a Good Crop: Discovering Secret Seeds in Text-to-Image Diffusion Models