Towards Experience-Centered AI: A Framework for Integrating Lived Experience in Design and Development
Not on the map. Why?
Abstract (arXiv)
Lived experiences fundamentally shape how individuals interact with AI systems, influencing perceptions of safety, trust, and usability. While prior research has focused on developing techniques to emulate human preferences, and proposed taxonomies to categorize risks (such as psychological harms and algorithmic biases), these efforts have provided limited systematic understanding of lived human experiences or actionable strategies for embedding them meaningfully into the AI development lifecycle. This work proposes a framework for meaningfully integrating lived experience into the design and evaluation of AI systems. We synthesize interdisciplinary literature across lived experience philosophy, human-centered design, and human-AI interaction, arguing that centering lived experience can lead to models that more accurately reflect the retrospective, emotional, and contextual dimensions of human cognition. Drawing from a wide body of work across psychology, education, healthcare, and social policy, we present a targeted taxonomy of lived experiences with specific applicability to AI systems. To ground our framework, we examine three application domains (i) education, (ii) healthcare, and (iii) cultural alignment, illustrating how lived experience informs user goals, system expectations, and ethical considerations in each context. We further incorporate insights from AI system operators and human-AI partnerships to highlight challenges in responsibility allocation, mental model calibration, and long-term system adaptation. We conclude with actionable recommendations for developing experience-centered AI systems that are not only technically robust but also empathetic, context-aware, and aligned with human realities. This work offers a foundation for future research that bridges technical development with the lived experiences of those impacted by AI systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 136 references that are in the map. First posted on arXiv 9 Aug 2025.
Builds on
15 of 136 references.
References · 15
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2018Datasheets for Datasetscited by 1,386
- 2018Model Cards for Model Reportingcited by 1,080
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
- 2020Artificial Intelligence, Values and Alignmentcited by 448
- 2019On Measuring Social Biases in Sentence Encoderscited by 398
- 2020Participatory Research for Low-resourced Machine Translation: A Case Study in African Languagescited by 159
- 2022Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reductioncited by 138
- 2023Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queriescited by 82
- 2024Unmasking and Quantifying Racial Bias of Large Language Models in Medical Report Generationcited by 31
- 2023Interactive AI Alignment: Specification, Process, and Evaluation Alignmentcited by 22
- 2024Lived Experience Not Found: LLMs Struggle to Align with Experts on Addressing Adverse Drug Reactions from Psychiatric Medication Usecited by 17
3 more
- 2022Benchmark datasets driving artificial intelligence development fail to capture the needs of medical professionalscited by 16
- 2023HumBEL: A Human-in-the-Loop Approach for Evaluating Demographic Factors of Language Models in Human-Machine Conversationscited by 6
- 2022Extreme Image Transformations Affect Humans and Machines Differentlycited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.