From Symptoms to Systems: An Expert-Guided Approach to Understanding Risks of Generative AI for Eating Disorders
Not on the map. Why?
Abstract (arXiv)
Generative AI systems may pose serious risks to individuals vulnerable to eating disorders. Existing safeguards tend to overlook subtle but clinically significant cues, leaving many risks unaddressed. To better understand the nature of these risks, we conducted semi-structured interviews with 15 clinicians, researchers, and advocates with expertise in eating disorders. Using abductive qualitative analysis, we developed an expert-guided taxonomy of generative AI risks across seven categories: (1) providing generalized health advice; (2) encouraging disordered behaviors; (3) supporting symptom concealment; (4) creating thinspiration; (5) reinforcing negative self-beliefs; (6) promoting excessive focus on the body; and (7) perpetuating narrow views about eating disorders. Our results demonstrate how certain user interactions with generative AI systems intersect with clinical features of eating disorders in ways that may intensify risk. We discuss implications of our work, including approaches for risk assessment, safeguard design, and participatory evaluation practices with domain experts.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 134 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
28 of 134 references.
References · 28
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 337
- 2021Multimodal datasets: misogyny, pornography, and malignant stereotypescited by 326
- 2022Easily Accessible Text-to-Image Generation Amplifies Demographic Stereotypes at Large Scalecited by 262
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2024Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Toolscited by 170
- 2022Power to the People? Opportunities and Challenges for Participatory AIcited by 137
- 2022Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reductioncited by 137
- 2024Benchmarking LLMs via Uncertainty Quantificationcited by 124
16 more
- 2024To Believe or Not to Believe Your LLMcited by 120
- 2024A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directionscited by 115
- 2025Measuring Sycophancy of Language Models in Multi-turn Dialoguescited by 91
- 2023The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practicecited by 86
- 2024AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policiescited by 69
- 2024"I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trustcited by 67
- 2023Analyzing Bias in Diffusion-based Face Generation Modelscited by 45
- 2024AI Safety in Generative AI Large Language Models: A Surveycited by 31
- 2024Bias in Generative AIcited by 19
- 2025Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effectscited by 18
- 2024The effect of fine-tuning on language model toxicitycited by 15
- 2024Acceptable Use Policies for Foundation Modelscited by 12
- 2024Private Yet Social: How LLM Chatbots Support and Challenge Eating Disorder Recoverycited by 8
- 2022The Distressing Ads That Persist: Uncovering The Harms of Targeted Weight-Loss Ads Among Users with Histories of Disordered Eatingcited by 5
- 2022Artificial Concepts of Artificial Intelligence: Institutional Compliance and Resistance in AI Startupscited by 4
- 2024Trusting the Search: Unraveling Human Trust in Health Information from Google and ChatGPTcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.