The Persistence of Cultural Memory: Investigating Multimodal Iconicity in Diffusion Models
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
The ambiguity between generalization and memorization in TTI diffusion models becomes pronounced when prompts invoke culturally shared visual references, a phenomenon we term multimodal iconicity. These are instances in which images and texts reflect established cultural associations, such as when a title recalls a familiar artwork or film scene. Such cases challenge existing approaches to evaluating memorization, as they define a setting in which instance-level memorization and culturally grounded generalization are structurally intertwined. To address this challenge, we propose an evaluation framework to assess a model's ability to remain culturally grounded without relying on visual replication. Specifically, we introduce the Cultural Reference Transformation (CRT) metric, which separates two dimensions of model behavior: Recognition, whether a model evokes a reference, from Realization, how it depicts it through replication or reinterpretation. We evaluate five diffusion models on 767 Wikidata-derived cultural references, covering both still and moving imagery, and find differences in how they respond to multimodal iconicity: some show weaker recognition, while others rely more heavily on replication. To assess linguistic sensitivity, we conduct prompt perturbation experiments using synonym substitutions and literal image descriptions, finding that models often reproduce iconic visual structures even when textual cues are altered. Finally, we find that cultural reference recognition correlates not only with training data frequency, but also textual uniqueness, reference popularity, and creation date. Our findings show that the behavior of diffusion models in culturally iconic settings cannot be reduced to simple reproduction, but depends on how references are recognized and realized, advancing evaluation beyond simple text-image matching toward richer contextual understanding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 38 of its 51 references that are in the map. First posted on arXiv 14 Nov 2025.
Builds on
38 of 51 references.
Closest ancestors · 5
Same direction, newest first
- 2025Culture in Action: Evaluating Text-to-Image Models through Social Activities7 Nov
- 2025Synthetic History: Evaluating Visual Representations of the Past in Diffusion Models18 May
- 2023Glaze: Protecting Artists from Style Mimicry by Text-to-Image Models8 Feb
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models7 Dec
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Models26 Oct
Other references · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2025DINOv3cited by 1,414
- 2023Extracting Training Data from Diffusion Modelscited by 732
- 2023Erasing Concepts from Diffusion Modelscited by 539
- 2024The Faiss librarycited by 376
- 2023Forget-Me-Not: Learning to Forget in Text-to-Image Diffusion Modelscited by 301
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2023Stable Bias: Analyzing Societal Representations in Diffusion Modelscited by 226
21 more
- 2023Understanding and Mitigating Copying in Diffusion Modelscited by 209
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 176
- 2024Defensive Unlearning with Adversarial Training for Robust Concept Erasure in Diffusion Modelscited by 168
- 2021Counterfactual Memorization in Neural Language Modelscited by 156
- 2022The Privacy Onion Effect: Memorization is Relativecited by 136
- 2023Ambient Diffusion: Learning Clean Distributions from Corrupted Datacited by 111
- 2024Detecting, Explaining, and Mitigating Memorization in Diffusion Modelscited by 95
- 2024Unveiling and Mitigating Memorization in Text-to-image Diffusion Models through Cross Attentioncited by 58
- 2023On the De-duplication of LAION-2Bcited by 47
- 2023Evaluating Data Attribution for Text-to-Image Modelscited by 45
- 2024Beyond Aesthetics: Cultural Competence in Text-to-Image Modelscited by 30
- 2024Holistic Unlearning Benchmark: A Multi-Faceted Evaluation for Text-to-Image Diffusion Model Unlearningcited by 21
- 2024Exploring Local Memorization in Diffusion Models via Bright Ending Attentioncited by 19
- 2023Navigating Cultural Chasms: Exploring and Unlocking the Cultural POV of Text-To-Image Modelscited by 16
- 2022The Myth of Culturally Agnostic AI Modelscited by 11
- 2021Embracing New Techniques in Deep Learning for Estimating Image Memorabilitycited by 10
- 2025Can Large Vision-Language Models Detect Images Copyright Infringement from GenAI?cited by 8
- 2025How Diffusion Models Memorizecited by 6
- 2024Image Copy Detection for Diffusion Modelscited by 4
- 2025CopyJudge: Automated Copyright Infringement Identification and Mitigation in Text-to-Image Diffusion Modelscited by 4
- 2025The Iconicity of the Generated Imagecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Diffusion Models Through a Global Lens: Are They Culturally Inclusive?
- 2025Toward Socially Aware Vision-Language Models: Evaluating Cultural Competence Through Multimodal Story Generation
- 2026ArtECulture: Benchmarking Culture-Conditioned Visual Emotion Understanding in Multimodal Large Language Models
- 2025Exposing Blindspots: Cultural Bias Evaluation in Generative Image Models
- 2025Deconstructing Bias: A Multifaceted Framework for Diagnosing Cultural and Compositional Inequities in Text-to-Image Generative Models
- 2022Language Does More Than Describe: On The Lack Of Figurative Speech in Text-To-Image Models
- 2023The Hidden Language of Diffusion Models
- 2026Would you still call this Dax? Novel Visual References in VLMs and Humans