DiffusionWorldViewer: Exposing and Broadening the Worldview Reflected by Generative Text-to-Image Models
Not on the map. Why?
Abstract (arXiv)
Generative text-to-image (TTI) models produce high-quality images from short textual descriptions and are widely used in academic and creative domains. Like humans, TTI models have a worldview, a conception of the world learned from their training data and task that influences the images they generate for a given prompt. However, the worldviews of TTI models are often hidden from users, making it challenging for users to build intuition about TTI outputs, and they are often misaligned with users' worldviews, resulting in output images that do not match user expectations. In response, we introduce DiffusionWorldViewer, an interactive interface that exposes a TTI model's worldview across output demographics and provides editing tools for aligning output images with user perspectives. In a user study with 18 diverse TTI users, we find that DiffusionWorldViewer helps users represent their varied viewpoints in generated images and challenge the limited worldview reflected in current TTI models.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 30 of its 64 references that are in the map. First posted on arXiv 18 Sep 2023.
Builds on
30 of 64 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
- 2023Unified Concept Editing in Diffusion Modelscited by 388
- 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 327
- 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
- 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 260
- 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 226
- 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 218
18 more
- 2019Gradio: Hassle-Free Sharing and Testing of ML Models in the Wildcited by 178
- 2019Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchycited by 156
- 2022Can Machines Help Us Answering Question 16 in Datasheets, and In Turn Reflecting on Inappropriate Content?cited by 155
- 2017No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing Worldcited by 153
- 2020Minimax Pareto Fairness: A Multi Objective Perspectivecited by 153
- 2023Fair Diffusion: Instructing Text-to-Image Generation Models on Fairnesscited by 151
- 2023Social Biases through the Text-to-Image Generation Lenscited by 127
- 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learningcited by 104
- 2020FairBatch: Batch Selection for Model Fairnesscited by 99
- 2019FairVis: Visual Analytics for Discovering Intersectional Bias in Machine Learningcited by 93
- 2022How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?cited by 92
- 2020High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsamplingcited by 79
- 2019Diversity in Facescited by 77
- 2019Embedding Comparator: Visualizing Differences in Global Structure and Local Neighborhoods via Small Multiplescited by 38
- 2020Ensuring Fairness Beyond the Training Datacited by 35
- 2022Markedness in Visual Semantic AIcited by 29
- 2022FORML: Learning to Reweight Data for Fairnesscited by 12
- 2019Human-Computer Insurrection: Notes on an Anarchist HCIcited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1; 2026: 1.
3 papers.