mlsanityData to 14 Oct 2026

DiffusionWorldViewer: Exposing and Broadening the Worldview Reflected by Generative Text-to-Image Models

arXiv 2309.09944 ↗First posted 18 Sep 2023cs.LG cs.AI cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Generative text-to-image (TTI) models produce high-quality images from short textual descriptions and are widely used in academic and creative domains. Like humans, TTI models have a worldview, a conception of the world learned from their training data and task that influences the images they generate for a given prompt. However, the worldviews of TTI models are often hidden from users, making it challenging for users to build intuition about TTI outputs, and they are often misaligned with users' worldviews, resulting in output images that do not match user expectations. In response, we introduce DiffusionWorldViewer, an interactive interface that exposes a TTI model's worldview across output demographics and provides editing tools for aligning output images with user perspectives. In a user study with 18 diverse TTI users, we find that DiffusionWorldViewer helps users represent their varied viewpoints in generated images and challenge the limited worldview reflected in current TTI models.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 30 of its 64 references that are in the map. First posted on arXiv 18 Sep 2023.

Builds on

30 of 64 references.

References · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  5. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
  6. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 513
  7. 2023Unified Concept Editing in Diffusion Modelscited by 388
  8. 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 327
  9. 2019Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Themcited by 268
  10. 2020Data and its (dis)contents: A survey of dataset development and use in machine learning researchcited by 260
  11. 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 226
  12. 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 218
18 more
  1. 2019Gradio: Hassle-Free Sharing and Testing of ML Models in the Wildcited by 178
  2. 2019Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchycited by 156
  3. 2022Can Machines Help Us Answering Question 16 in Datasheets, and In Turn Reflecting on Inappropriate Content?cited by 155
  4. 2017No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing Worldcited by 153
  5. 2020Minimax Pareto Fairness: A Multi Objective Perspectivecited by 153
  6. 2023Fair Diffusion: Instructing Text-to-Image Generation Models on Fairnesscited by 151
  7. 2023Social Biases through the Text-to-Image Generation Lenscited by 127
  8. 2022A Prompt Array Keeps the Bias Away: Debiasing Vision-Language Models with Adversarial Learningcited by 104
  9. 2020FairBatch: Batch Selection for Model Fairnesscited by 99
  10. 2019FairVis: Visual Analytics for Discovering Intersectional Bias in Machine Learningcited by 93
  11. 2022How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?cited by 92
  12. 2020High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsamplingcited by 79
  13. 2019Diversity in Facescited by 77
  14. 2019Embedding Comparator: Visualizing Differences in Global Structure and Local Neighborhoods via Small Multiplescited by 38
  15. 2020Ensuring Fairness Beyond the Training Datacited by 35
  16. 2022Markedness in Visual Semantic AIcited by 29
  17. 2022FORML: Learning to Reweight Data for Fairnesscited by 12
  18. 2019Human-Computer Insurrection: Notes on an Anarchist HCIcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 0; 2025: 1; 2026: 1.

3 papers.