Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex structures and operations often pose challenges for non-experts to grasp. We present Diffusion Explainer, the first interactive visualization tool that explains how Stable Diffusion transforms text prompts into images. Diffusion Explainer tightly integrates a visual overview of Stable Diffusion's complex structure with explanations of the underlying operations. By comparing image generation of prompt variants, users can discover the impact of keyword changes on image generation. A 56-participant user study demonstrates that Diffusion Explainer offers substantial learning benefits to non-experts. Our tool has been used by over 10,300 users from 124 countries at https://poloclub.github.io/diffusion-explainer/.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 14 of its 52 references that are in the map. First posted on arXiv 4 May 2023.
Builds on
14 of 52 references.
Closest ancestors · 1
Same direction, newest first
Other references · 13
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 218
- 2020CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualizationcited by 57
- 2017ActiVis: Visual Exploration of Industry-Scale Deep Neural Network Modelscited by 56
- 2022A Taxonomy of Prompt Modifiers for Text-To-Image Generationcited by 55
- 2018GAN Lab: Understanding Complex Deep Generative Models using Interactive Visual Experimentationcited by 41
- 2017Direct-Manipulation Visualization of Deep Networkscited by 28
- 2017Adversarial-Playground: A Visualization Suite Showing How Adversarial Examples Fool Deep Learningcited by 8
Built on by
Citing papers per year: 2023: 2; 2024: 8; 2025: 4; 2026: 3.
17 papers.
Sort:
By area:
- 2023On the Design Fundamentals of Diffusion Models: A Surveycited by 60
- 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Surveycited by 52
- 2023Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiencescited by 21
- 2024Transformer Explainer: Learning LLM Transformers with Interactive Visual Explanation and Experimentationcited by 10
- 2024Global-Local Image Perceptual Score (GLIPS): Evaluating Photorealistic Quality of AI-Generated Imagescited by 7
- 2024Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Surveycited by 6
- 2024ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scalecited by 5
- 2025AI Generated Child Sexual Abuse Material -- What's the Harm?cited by 5
- 2024EvolvED: Evolutionary Embeddings to Understand the Generation Process of Diffusion Modelscited by 3
- 2024Mapping the Mind of an Instruction-based Image Editing using SMILEcited by 3
- 2025Scene Perceived Image Perceptual Score (SPIPS): combining global and local perception for image quality assessmentcited by 1
- 2025ChannelExplorer: Exploring Class Separability Through Activation Channel Visualizationcited by 1
5 more
- 2025Diffusion Explorer: Interactive Exploration of Diffusion Modelscited by 1
- 2024VAE Explainer: Supplement Learning Variational Autoencoders with Interactive Visualizationcited by 0
- 2026Attention Dynamics in Diffusion Models: A Visual Analytics Framework for Human-AI Collaborationcited by 0
- 2026ASAP: Visual Analytics for Identifying and Analyzing Image Patterns in AI-generated Imagescited by 0
- 2026Persistent Watermarking of Text-to-Image Modelscited by 0
- 2026Persistent Watermarking of Text-to-Image Models30 Sep 2026
- 2026ASAP: Visual Analytics for Identifying and Analyzing Image Patterns in AI-generated Images23 Sep 2026
- 2026Attention Dynamics in Diffusion Models: A Visual Analytics Framework for Human-AI Collaboration28 Jun 2026
- 2025AI Generated Child Sexual Abuse Material -- What's the Harm?3 Oct 2025
- 2025Diffusion Explorer: Interactive Exploration of Diffusion Models1 Jul 2025
- 2025ChannelExplorer: Exploring Class Separability Through Activation Channel Visualization6 May 2025
- 2025Scene Perceived Image Perceptual Score (SPIPS): combining global and local perception for image quality assessment24 Apr 2025
- 2024Mapping the Mind of an Instruction-based Image Editing using SMILE20 Dec 2024
- 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Survey3 Dec 2024
- 2024Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Survey26 Sep 2024
- 2024VAE Explainer: Supplement Learning Variational Autoencoders with Interactive Visualization13 Sep 2024
- 2024Transformer Explainer: Learning LLM Transformers with Interactive Visual Explanation and Experimentation8 Aug 2024
5 more
- 2024EvolvED: Evolutionary Embeddings to Understand the Generation Process of Diffusion Models25 Jun 2024
- 2024Global-Local Image Perceptual Score (GLIPS): Evaluating Photorealistic Quality of AI-Generated Images15 May 2024
- 2024ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scale3 Apr 2024
- 2023Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences6 Oct 2023
- 2023On the Design Fundamentals of Diffusion Models: A Survey7 Jun 2023
- 2023On the Design Fundamentals of Diffusion Models: A Surveycited by 60
- 2024Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Surveycited by 6
- 2024ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scalecited by 5
- 2024EvolvED: Evolutionary Embeddings to Understand the Generation Process of Diffusion Modelscited by 3
- 2025ChannelExplorer: Exploring Class Separability Through Activation Channel Visualizationcited by 1
- 2025Diffusion Explorer: Interactive Exploration of Diffusion Modelscited by 1
- 2026Attention Dynamics in Diffusion Models: A Visual Analytics Framework for Human-AI Collaborationcited by 0
- 2026Attention Dynamics in Diffusion Models: A Visual Analytics Framework for Human-AI Collaboration28 Jun 2026
- 2025Diffusion Explorer: Interactive Exploration of Diffusion Models1 Jul 2025
- 2025ChannelExplorer: Exploring Class Separability Through Activation Channel Visualization6 May 2025
- 2024Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Survey26 Sep 2024
- 2024EvolvED: Evolutionary Embeddings to Understand the Generation Process of Diffusion Models25 Jun 2024
- 2024ASAP: Interpretable Analysis and Summarization of AI-generated Image Patterns at Scale3 Apr 2024
- 2023On the Design Fundamentals of Diffusion Models: A Survey7 Jun 2023
- 2026Persistent Watermarking of Text-to-Image Modelscited by 0
- 2026Persistent Watermarking of Text-to-Image Models30 Sep 2026
- 2023Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiencescited by 21
- 2024Transformer Explainer: Learning LLM Transformers with Interactive Visual Explanation and Experimentationcited by 10
- 2024Global-Local Image Perceptual Score (GLIPS): Evaluating Photorealistic Quality of AI-Generated Imagescited by 7
- 2025AI Generated Child Sexual Abuse Material -- What's the Harm?cited by 5
- 2024Mapping the Mind of an Instruction-based Image Editing using SMILEcited by 3
- 2025Scene Perceived Image Perceptual Score (SPIPS): combining global and local perception for image quality assessmentcited by 1
- 2024VAE Explainer: Supplement Learning Variational Autoencoders with Interactive Visualizationcited by 0
- 2026ASAP: Visual Analytics for Identifying and Analyzing Image Patterns in AI-generated Imagescited by 0
- 2026ASAP: Visual Analytics for Identifying and Analyzing Image Patterns in AI-generated Images23 Sep 2026
- 2025AI Generated Child Sexual Abuse Material -- What's the Harm?3 Oct 2025
- 2025Scene Perceived Image Perceptual Score (SPIPS): combining global and local perception for image quality assessment24 Apr 2025
- 2024Mapping the Mind of an Instruction-based Image Editing using SMILE20 Dec 2024
- 2024VAE Explainer: Supplement Learning Variational Autoencoders with Interactive Visualization13 Sep 2024
- 2024Transformer Explainer: Learning LLM Transformers with Interactive Visual Explanation and Experimentation8 Aug 2024
- 2024Global-Local Image Perceptual Score (GLIPS): Evaluating Photorealistic Quality of AI-Generated Images15 May 2024
- 2023Model Compression in Practice: Lessons Learned from Practitioners Creating On-device Machine Learning Experiences6 Oct 2023
Similar, not cited
Close in wording, no citation either way
- 2024Interactive Visual Learning for Stable Diffusion
- 2024Explaining generative diffusion models via visual analysis for interpretable decision-making process
- 2023The Hidden Language of Diffusion Models
- 2024DiffusionPID: Interpreting Diffusion via Partial Information Decomposition
- 2025Emergence and Evolution of Interpretable Concepts in Diffusion Models
- 2025Blending Concepts with Text-to-Image Diffusion Models
- 2023Reverse Stable Diffusion: What prompt was used to generate this image?
- 2023Are Diffusion Models Vision-And-Language Reasoners?