A Risk Taxonomy and Reflection Tool for Large Language Model Adoption in Public Health
Not on the map. Why?
Abstract (arXiv)
Recent breakthroughs in large language models (LLMs) have generated both interest and concern about their potential adoption as information sources or communication tools across different domains. In public health, where stakes are high and impacts extend across diverse populations, adopting LLMs poses unique challenges that require thorough evaluation. However, structured approaches for assessing potential risks in public health remain under-explored. To address this gap, we conducted focus groups with public health professionals and individuals with lived experience to unpack their concerns, situated across three distinct and critical public health issues that demand high-quality information: infectious disease prevention (vaccines), chronic and well-being care (opioid use disorder), and community health and safety (intimate partner violence). We synthesize participants' perspectives into a risk taxonomy, identifying and contextualizing the potential harms LLMs may introduce when positioned alongside traditional health communication. This taxonomy highlights four dimensions of risk to individuals, human-centered care, information ecosystem, and technology accountability. For each dimension, we unpack specific risks and offer example reflection questions to help practitioners adopt a risk-reflexive approach. By summarizing distinctive LLM characteristics and linking them to identified risks, we discuss the need to revisit prior mental models of information behaviors and complement evaluations with external validity and domain expertise through lived experience and real-world practices. Together, this work contributes a shared vocabulary and reflection tool for people in both computing and public health to collaboratively anticipate, evaluate, and mitigate risks in deciding when to employ LLM capabilities (or not) and how to mitigate harm.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 43 of its 172 references that are in the map. First posted on arXiv 4 Nov 2024.
Builds on
43 of 172 references.
References · 43
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2018QuAC : Question Answering in Contextcited by 379
- 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
- 2022Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reductioncited by 137
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
- 2022Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Languagecited by 81
- 2019Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AIcited by 79
31 more
- 2023"It's a Fair Game", or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agentscited by 60
- 2023"I'm fully who I am": Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generationcited by 56
- 2023Large Language Models to Identify Social Determinants of Health in Electronic Health Recordscited by 55
- 2024A Toolbox for Surfacing Health Equity Harms and Biases in Large Language Modelscited by 45
- 2023Is Stack Overflow Obsolete? An Empirical Study of the Characteristics of ChatGPT Answers to Stack Overflow Questionscited by 42
- 2021Which Linguist Invented the Lightbulb? Presupposition Verification for Question-Answeringcited by 41
- 2023Benefits and Harms of Large Language Models in Digital Mental Healthcited by 39
- 2021Transitioning to human interaction with AI systems: New challenges and opportunities for HCI professionals to enable human-centered AIcited by 38
- 2023Improving Human-AI Collaboration With Descriptions of AI Behaviorcited by 35
- 2022Advancing Human-AI Complementarity: The Impact of User Expertise and Algorithmic Tuning on Joint Decision Makingcited by 33
- 2017Personalization in Goal-Oriented Dialogcited by 28
- 2020Intent Mining from past conversations for conversational agentcited by 25
- 2024Why and When LLM-Based Assistants Can Go Wrong: Investigating the Effectiveness of Prompt-Based Interactions for Software Help-Seekingcited by 24
- 2020A Human-Centered Review of the Algorithms used within the U.S. Child Welfare Systemcited by 23
- 2021A Framework of Severity for Harmful Content Onlinecited by 22
- 2022Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservablescited by 19
- 2024Lived Experience Not Found: LLMs Struggle to Align with Experts on Addressing Adverse Drug Reactions from Psychiatric Medication Usecited by 17
- 2021An Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregiverscited by 15
- 2024The Situate AI Guidebook: Co-Designing a Toolkit to Support Multi-Stakeholder Early-stage Deliberations Around Public Sector AI Proposalscited by 15
- 2023NLP for Maternal Healthcare: Perspectives and Guiding Principles in the Age of LLMscited by 14
- 2024Evaluating the Experience of LGBTQ+ People Using Large Language Model Based Chatbots for Mental Health Supportcited by 14
- 2019Challenges of Human-Aware AI Systemscited by 13
- 2021Online misinformation is linked to early COVID-19 vaccination hesitancy and refusalcited by 13
- 2021Social Media Polarization and Echo Chambers in the Context of COVID-19: Case Studycited by 12
- 2019In a Silent Way: Communication Between AI and Improvising Musicians Beyond Soundcited by 11
- 2018PlayeRank: data-driven performance evaluation and player ranking in soccer via a machine learning approachcited by 10
- 2022A Test for Evaluating Performance in Human-Computer Systemscited by 8
- 2024Mapping the individual, social, and biospheric impacts of Foundation Modelscited by 8
- 2024Comparing Zealous and Restrained AI Recommendations in a Real-World Human-AI Collaboration Taskcited by 8
- 2021Designing Transparency Cues in Online News Platforms to Promote Trust: Journalists' & Consumers' Perspectivescited by 3
- 2023Practicing Information Sensibility: How Gen Z Engages with Online Informationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.