Provocations from the Humanities for Generative AI Research
Not on the map. Why?
Abstract (arXiv)
The effects of generative AI are experienced by a broad range of constituencies, but the disciplinary inputs to its development have been surprisingly narrow. Here we present a set of provocations from humanities researchers -- currently underrepresented in AI development -- intended to inform its future applications and enrich ongoing conversations about its uses, impact, and harms. Drawing from relevant humanities scholarship, along with foundational work in critical data studies, we elaborate eight claims with broad applicability to generative AI research: 1) Models make words, but people make meaning; 2) Generative AI requires an expanded definition of culture; 3) Generative AI can never be representative; 4) Bigger models are not always better models; 5) Not all training data is equivalent; 6) Openness is not an easy fix; 7) Limited access to compute enables corporate capture; and 8) AI universalism creates narrow human subjects. We also provide a working definition of humanities research, summarize some of its most salient theories and methods, and apply these theories and methods to the current landscape of AI. We conclude with a discussion of the importance of resisting the extraction of humanities research by computer science and related fields.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 37 of its 175 references that are in the map. First posted on arXiv 26 Feb 2025.
Builds on
37 of 175 references.
References · 37
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2018Datasheets for Datasetscited by 1,386
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2018Model Cards for Model Reportingcited by 1,080
- 2023Whose Opinions Do Language Models Reflect?cited by 773
- 2022Challenges and Strategies in Cross-Cultural NLPcited by 218
- 2023Inverse Scaling: When Bigger Isn't Bettercited by 207
- 2020A Survey of the State of Explainable AI for Natural Language Processingcited by 206
- 2023Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Studycited by 206
- 2023A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicitycited by 182
- 2024Towards Measuring and Modeling "Culture" in LLMs: A Surveycited by 167
- 2024Investigating Cultural Alignment of Large Language Modelscited by 143
25 more
- 2023Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4cited by 125
- 2019Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learningcited by 116
- 2023Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensionscited by 112
- 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
- 2022Theories of "Gender" in NLP Bias Researchcited by 62
- 2024Careless Whisper: Speech-to-Text Hallucination Harmscited by 53
- 2022Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learningcited by 48
- 2021Addressing "Documentation Debt" in Machine Learning Research: A Retrospective Datasheet for BookCorpuscited by 47
- 2024Confabulation: The Surprising Value of Large Language Model Hallucinationscited by 43
- 2025Culture is Not Trivia: Sociocultural Theory for Cultural NLPcited by 40
- 2020Algorithmic Fairness from a Non-ideal Perspectivecited by 30
- 2024Extrinsic Evaluation of Cultural Competence in Large Language Modelscited by 24
- 2024Sonnet or Not, Bot? Poetry Evaluation for Large Models and Datasetscited by 18
- 2023Algorithmic Pluralism: A Structural Approach To Equal Opportunitycited by 13
- 2024Does ChatGPT Have a Poetic Style?cited by 12
- 2022The Myth of Culturally Agnostic AI Modelscited by 11
- 2024Vision-Language Models under Cultural and Inclusive Considerationscited by 8
- 2024Watching the Generative AI Hype Bubble Deflatecited by 8
- 2022Social Inclusion in Curated Contexts: Insights from Museum Practicescited by 7
- 2022BERT in Plutarch's Shadowscited by 6
- 2023If the Sources Could Talk: Evaluating Large Language Models for Research Assistance in Historycited by 5
- 2024The Power of Absence: Thinking with Archival Theory in Algorithmic Designcited by 5
- 2024Responsible Adoption of Generative AI in Higher Education: Developing a "Points to Consider" Approach Based on Faculty Perspectivescited by 5
- 2022Broadening AI Ethics Narratives: An Indic Art Viewcited by 3
- 2025Data Ecofeminismcited by 2
Built on by
Citing papers per year: 2025: 3; 2026: 7.
10 papers.
- 2025Meaning Is Not A Metric: Using LLMs to make cultural context legible at scalecited by 10
- 2026Computational Hermeneutics: Evaluating generative AI as a cultural technologycited by 8
- 2026AI as Entertainmentcited by 2
- 2025Estranged Predictions: Measuring Semantic Category Disruption with Masked Language Modellingcited by 1
- 2025The Differential Meaning of Models: A Framework for Analyzing the Structural Consequences of Semantic Modeling Decisionscited by 0
- 2026Where Models Converge and Humans Diverge: A Coverage Framework for Distributional Pluralism in Open-Ended Generationcited by 0
- 2026Calibrated Ambiguity in Multimodal Language Models: Humans reach for cultural references, while models describe the picturecited by 0
- 2026Reciprocal Collaboration: how lessons from convergence in GLAMs can enhance interdisciplinary AI researchcited by 0
- 2026Large Language Models, Machine-Assisted Cultural Analytics, and the Agentic Turncited by 0
- 2026Crossing the Gender Binary: Modelling Gendered Reference in Science Fiction and General Fictioncited by 0
- 2026Crossing the Gender Binary: Modelling Gendered Reference in Science Fiction and General Fiction13 Oct 2026
- 2026Large Language Models, Machine-Assisted Cultural Analytics, and the Agentic Turn8 Oct 2026
- 2026Reciprocal Collaboration: how lessons from convergence in GLAMs can enhance interdisciplinary AI research22 Sep 2026
- 2026Calibrated Ambiguity in Multimodal Language Models: Humans reach for cultural references, while models describe the picture11 Sep 2026
- 2026Where Models Converge and Humans Diverge: A Coverage Framework for Distributional Pluralism in Open-Ended Generation6 Aug 2026
- 2026Computational Hermeneutics: Evaluating generative AI as a cultural technology31 Mar 2026
- 2026AI as Entertainment13 Jan 2026
- 2025Estranged Predictions: Measuring Semantic Category Disruption with Masked Language Modelling11 Nov 2025
- 2025The Differential Meaning of Models: A Framework for Analyzing the Structural Consequences of Semantic Modeling Decisions29 Aug 2025
- 2025Meaning Is Not A Metric: Using LLMs to make cultural context legible at scale23 May 2025