Characterizing Cultural Localization in AI-Generated Stories
Not on the map. Why?
Abstract (arXiv)
The global use of artificial intelligence has increased interest in assessing the ability to generate culturally localized content, including stories. Cultural localization in stories often occurs through either templated localization -- the use of cultural markers (e.g., names, locations) in a generic narrative -- or holistic localization -- the variation of plots, values, and themes, in addition to cultural markers. We propose a method to measure the degree to which content was generated through templated localization. Specifically, we identify the lexical tokens that distinguish stories across nationalities and measure the similarity of the narratives that remain after removing them. In stories generated by five models on 125 topics for 193 nationalities, our method is able to detect that only a small subset (9-17%) of the vocabulary accounts for the variation across nationalities and that the narratives that remain after removing them contain repeated multi-word sequences, suggesting the presence of a shared culturally-agnostic narrative template. Finally, we characterize the cultural markers for their stereotypicality and offensiveness, finding that markers from 19 countries, mostly located in the Global South, are on average offensive.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 88 references that are in the map. First posted on arXiv 12 Jun 2026.
Builds on
51 of 88 references.
References · 51
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 437
- 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 338
- 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 234
- 2024Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluationcited by 191
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
- 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 141
- 2019Strategies for Structuring Story Generationcited by 124
- 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
- 2021Re-imagining Algorithmic Fairness in India and Beyondcited by 104
- 2020Content Planning for Neural Story Generation with Aristotelian Rescoringcited by 92
38 more
- 2024Are Large Language Models Capable of Generating Human-Level Narratives?cited by 79
- 2023SeeGULL: A Stereotype Benchmark with Broad Geo-Cultural Coverage Leveraging Generative Modelscited by 66
- 2017Event Representations for Automated Story Generation with Deep Neural Netscited by 63
- 2014Narrative Planning: Balancing Plot and Charactercited by 61
- 2018Learning Neural Templates for Text Generationcited by 61
- 2024AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuancescited by 60
- 2022Re-contextualizing Fairness in NLP: The Case of Indiacited by 55
- 2024CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Promptingcited by 55
- 2024Standardizing the Measurement of Text Diversity: A Tool and a Comparative Analysis of Scorescited by 50
- 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 48
- 2024Echoes in AI: Quantifying lack of plot diversity in LLM outputscited by 48
- 2025mmBERT: A Modern Multilingual Encoder with Annealed Language Learningcited by 45
- 2024Detection and Measurement of Syntactic Templates in Generated Textcited by 44
- 2018A Skeleton-Based Model for Promoting Coherence Among Sentences in Narrative Story Generationcited by 42
- 2020Template-Based Question Generation from Retrieved Sentences for Improved Unsupervised Question Answeringcited by 39
- 2024An image speaks a thousand words, but can everyone listen? On image transcreation for cultural relevancecited by 36
- 2023EtiCor: Corpus for Analyzing LLMs for Etiquettescited by 33
- 2025The Shrinking Landscape of Linguistic Diversity in the Age of Large Language Modelscited by 29
- 2023Experimental Narratives: A Comparison of Human Crowdsourced Storytelling and AI Storytellingcited by 27
- 2023Building Socio-culturally Inclusive Stereotype Resources with Community Engagementcited by 25
- 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
- 2017Community Identity and User Engagement in a Multi-Community Landscapecited by 18
- 2025The Case for "Thick Evaluations" of Cultural Representation in AIcited by 17
- 2025SANSKRITI: A Comprehensive Benchmark for Evaluating Language Models' Knowledge of Indian Culturecited by 16
- 2025Biased Tales: Cultural and Topic Bias in Generating Children's Storiescited by 15
- 2022Words as Gatekeepers: Measuring Discipline-specific Terms and Meanings in Scholarly Publicationscited by 14
- 2025How Deep Is Representational Bias in LLMs? The Cases of Caste and Religioncited by 14
- 2025QUDsim: Quantifying Discourse Similarities in LLM-Generated Textcited by 13
- 2025STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generationcited by 10
- 2025TALES: A Taxonomy and Analysis of Cultural Representations in LLM-generated Storiescited by 10
- 2018The Importance of Generation Order in Language Modelingcited by 9
- 2024Richer Output for Richer Countries: Uncovering Geographical Disparities in Generated Stories and Travel Recommendationscited by 9
- 2026Can Good Writing Be Generative? Expert-Level AI Writing Emerges through Fine-Tuning on High-Quality Bookscited by 9
- 2024Towards Automatic Evaluation for Image Transcreationcited by 7
- 2025DIWALI: Diversity and Inclusivity aWare cuLture specific Items for India: Dataset and Assessment of LLMs for Cultural Text Adaptation in Indian Contextcited by 5
- 2024Measuring Machine Learning Harms from Stereotypes Requires Understanding Who Is Harmed by Which Errors in What Wayscited by 4
- 2024KAHANI: Culturally-Nuanced Visual Storytelling Tool for Non-Western Culturescited by 4
- 2025Research Borderlands: Analysing Writing Across Research Culturescited by 3
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.