mlsanityData to 7 Oct 2026

Uncovering Regional Defaults from Photorealistic Forests in Text-to-Image Generation with DALL-E 2

arXiv 2410.17255 ↗First posted 3 Oct 2024cs.CY cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Regional defaults describe the emerging phenomenon that text-to-image (T2I) foundation models used in generative AI are prone to over-proportionally depicting certain geographic regions to the exclusion of others. In this work, we introduce a scalable evaluation for uncovering such regional defaults. The evaluation consists of region hierarchy--based image generation and cross-level similarity comparisons. We carry out an experiment by prompting DALL-E 2, a state-of-the-art T2I generation model capable of generating photorealistic images, to depict a forest. We select forest as an object class that displays regional variation and can be characterized using spatial statistics. For a region in the hierarchy, our experiment reveals the regional defaults implicit in DALL-E 2, along with their scale-dependent nature and spatial relationships. In addition, we discover that the implicit defaults do not necessarily correspond to the most widely forested regions in reality. Our findings underscore a need for further investigation into the geography of T2I generation and other forms of generative AI.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 7 of its 12 references that are in the map. First posted on arXiv 3 Oct 2024.

Builds on

7 of 12 references.

References · 7

  1. 2019Language Models as Knowledge Bases?cited by 1,922
  2. 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
  3. 2023GPT4GEO: How a Language Model Sees the World's Geographycited by 68
  4. 2023AI's Regimes of Representation: A Community-centered Study of Text-to-Image Models in South Asiacited by 54
  5. 2023Philosophical Foundations of GeoAI: Exploring Sustainability, Diversity, and Bias in GeoAI and Spatial Data Sciencecited by 11
  6. 2024Measuring Geographic Diversity of Foundation Models with a Natural Language--based Geo-guessing Experiment on GPT-4cited by 8
  7. 2024Pre-Trained Language Models Represent Some Geographic Populations Better Than Otherscited by 6

Built on by

Not cited yet.