mlsanityData to 7 Oct 2026

Ontologies in Design: How Imagining a Tree Reveals Possibilites and Assumptions in Large Language Models

arXiv 2504.03029 ↗First posted 3 Apr 2025cs.HC cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Amid the recent uptake of Generative AI, sociotechnical scholars and critics have traced a multitude of resulting harms, with analyses largely focused on values and axiology (e.g., bias). While value-based analyses are crucial, we argue that ontologies -- concerning what we allow ourselves to think or talk about -- is a vital but under-recognized dimension in analyzing these systems. Proposing a need for a practice-based engagement with ontologies, we offer four orientations for considering ontologies in design: pluralism, groundedness, liveliness, and enactment. We share examples of potentialities that are opened up through these orientations across the entire LLM development pipeline by conducting two ontological analyses: examining the responses of four LLM-based chatbots in a prompting exercise, and analyzing the architecture of an LLM-based agent simulation. We conclude by sharing opportunities and limitations of working with ontologies in the design and development of sociotechnical systems.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 37 of its 157 references that are in the map. First posted on arXiv 3 Apr 2025.

Builds on

37 of 157 references.

References · 37

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  4. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  5. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  6. 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
  7. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  8. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
  9. 2020CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Modelscited by 703
  10. 2023Cognitive Architectures for Language Agentscited by 422
  11. 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 294
  12. 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
25 more
  1. 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 230
  2. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 210
  3. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
  4. 2023Cultural Bias and Cultural Alignment of Large Language Modelscited by 149
  5. 2020REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasetscited by 136
  6. 2024Collective Constitutional AI: Aligning a Language Model with Public Inputcited by 120
  7. 2022Jury Learning: Integrating Dissenting Voices into Machine Learning Modelscited by 115
  8. 2024EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithmscited by 109
  9. 2023CoMPosT: Characterizing and Evaluating Caricature in LLM Simulationscited by 94
  10. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generationcited by 80
  11. 2024Evaluating Large Language Model Biases in Persona-Steered Generationcited by 78
  12. 2024Unintended Impacts of LLM Alignment on Global Representationcited by 66
  13. 2022In conversation with Artificial Intelligence: aligning language models with human valuescited by 61
  14. 2021Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Modelscited by 57
  15. 2022Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selectioncited by 52
  16. 2023When Do Annotator Demographics Matter? Measuring the Influence of Annotator Demographics with the POPQUORN Datasetcited by 51
  17. 2023GeoDE: a Geographically Diverse Evaluation Dataset for Object Recognitioncited by 50
  18. 2024Aligning Language Models with Demonstrated Feedbackcited by 32
  19. 2024Position: Measure Dataset Diversity, Don't Just Claim Itcited by 26
  20. 2024Balancing Diversity and Risk in LLM Sampling: How to Select Your Method and Parameter for Open-Ended Text Generationcited by 18
  21. 2022The Birth of Bias: A case study on the evolution of gender bias in an English language modelcited by 16
  22. 2023Bias A-head? Analyzing Bias in Transformer-Based Language Model Attention Headscited by 13
  23. 2024Do Multilingual Large Language Models Mitigate Stereotype Bias?cited by 13
  24. 2024Understanding the Role of Temperature in Diverse Question Generation by GPT-4cited by 5
  25. 2024The Power of Absence: Thinking with Archival Theory in Algorithmic Designcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Generative Ontology: When Structured Knowledge Learns to Create
  2. 2026On the Creativity of AI Agents
  3. 2024Conversational Agents as Catalysts for Critical Thinking: Challenging Design Fixation in Group Design
  4. 2026Socially Grounded Agentic AI: Coordinating Plural Perspectives through Social Theory
  5. 2025Recognizing Artificial Minds: A Philosophical Defense of AI Cognition
  6. 2026Critique of Agent Model
  7. 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?
  8. 2025Humanizing Machines: Rethinking LLM Anthropomorphism Through a Multi-Level Framework of Design