Ontologies in Design: How Imagining a Tree Reveals Possibilites and Assumptions in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Amid the recent uptake of Generative AI, sociotechnical scholars and critics have traced a multitude of resulting harms, with analyses largely focused on values and axiology (e.g., bias). While value-based analyses are crucial, we argue that ontologies -- concerning what we allow ourselves to think or talk about -- is a vital but under-recognized dimension in analyzing these systems. Proposing a need for a practice-based engagement with ontologies, we offer four orientations for considering ontologies in design: pluralism, groundedness, liveliness, and enactment. We share examples of potentialities that are opened up through these orientations across the entire LLM development pipeline by conducting two ontological analyses: examining the responses of four LLM-based chatbots in a prompting exercise, and analyzing the architecture of an LLM-based agent simulation. We conclude by sharing opportunities and limitations of working with ontologies in the design and development of sociotechnical systems.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 37 of its 157 references that are in the map. First posted on arXiv 3 Apr 2025.
Builds on
37 of 157 references.
References · 37
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
- 2023Cognitive Architectures for Language Agentscited by 422
- 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 294
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
25 more
- 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 230
- 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 210
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
- 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
- 2020REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasetscited by 136
- 2024Collective Constitutional AI: Aligning a Language Model with Public Inputcited by 120
- 2022Jury Learning: Integrating Dissenting Voices into Machine Learning Modelscited by 115
- 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
- 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
- 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 80
- 2024Evaluating Large Language Model Biases in Persona-Steered Generationcited by 78
- 2024Unintended Impacts of LLM Alignment on Global Representationcited by 66
- 2022In conversation with Artificial Intelligence: aligning language models with human valuescited by 61
- 2021Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Modelscited by 57
- 2022Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selectioncited by 52
- 2023When Do Annotator Demographics Matter? Measuring the Influence of Annotator Demographics with the POPQUORN Datasetcited by 51
- 2023GeoDE: a Geographically Diverse Evaluation Dataset for Object Recognitioncited by 50
- 2024Aligning Language Models with Demonstrated Feedbackcited by 32
- 2024Position: Measure Dataset Diversity, Don't Just Claim Itcited by 26
- 2024Balancing Diversity and Risk in LLM Sampling: How to Select Your Method and Parameter for Open-Ended Text Generationcited by 18
- 2022The Birth of Bias: A case study on the evolution of gender bias in an English language modelcited by 16
- 2023Bias A-head? Analyzing Bias in Transformer-Based Language Model Attention Headscited by 13
- 2024Do Multilingual Large Language Models Mitigate Stereotype Bias?cited by 13
- 2024Understanding the Role of Temperature in Diverse Question Generation by GPT-4cited by 5
- 2024The Power of Absence: Thinking with Archival Theory in Algorithmic Designcited by 5
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Plural Voices, Single Agent: Towards Inclusive AI in Multi-User Domestic Spacescited by 0
- 2026When to Ask a Question: Understanding Communication Strategies in Generative AI Toolscited by 0
- 2026Human-Simulation Interaction: From Prediction to Exploration in LLM Agent Simulations for Policycited by 0
- 2026Human-Simulation Interaction: From Prediction to Exploration in LLM Agent Simulations for Policy17 Jun 2026
- 2026When to Ask a Question: Understanding Communication Strategies in Generative AI Tools11 May 2026
- 2025Plural Voices, Single Agent: Towards Inclusive AI in Multi-User Domestic Spaces21 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Generative Ontology: When Structured Knowledge Learns to Create
- 2026On the Creativity of AI Agents
- 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Design
- 2026Socially Grounded Agentic AI: Coordinating Plural Perspectives through Social Theory
- 2025Recognizing Artificial Minds: A Philosophical Defense of AI Cognition
- 2026Critique of Agent Model
- 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?
- 2025Humanizing Machines: Rethinking LLM Anthropomorphism Through a Multi-Level Framework of Design