Inform, Coach, Relate, Listen: Auditing LLM Caregiving Support Roles
Not on the map. Why?
Abstract (arXiv)
Language models are increasingly being deployed for conversational support in informal caregiving contexts, where interactions often extend beyond information-seeking: caregivers seek emotional reassurance, guidance, and help, while navigating uncertain, relationally complex care decisions. Yet most safety evaluations assess model behavior under generic prompts, leaving a critical question unexamined: does a model's safety profile change with its support role? We study this by operationalizing four expert-reviewed support roles grounded in social support theory: Inform, Coach, Relate, and Listen, and comparing them against two baseline controls: a basic prompting condition and a retrieval-augmented generation (RAG) condition. We evaluate across three language models (GPT-4o-mini, Llama-3.1-8B-Instruct, and MedGemma-1.5-4b-it) on 5,000 real-world queries from online Alzheimer's Disease and Related Dementias (ADRD) communities. We find that the LLM's support role systematically shapes both the prevalence and composition of interactional risks. Furthermore, a human evaluation study reveals a perceived quality--safety tension: more directive, information-oriented roles are rated as more helpful and trustworthy despite exhibiting elevated interactional risk profiles. We release ~90,000 support role-conditioned model responses with risk annotations as an ecologically grounded resource for research on safer LLM-mediated conversational support.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 49 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
18 of 49 references.
References · 18
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
- 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
- 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 155
- 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 154
- 2019A Question-Entailment Approach to Question Answeringcited by 134
- 2024SG-Bench: Evaluating LLM Safety Generalization Across Diverse Tasks and Prompt Typescited by 60
- 2025Customizing Emotional Support: How Do Individuals Construct and Interact With LLM-Powered Chatbotscited by 25
6 more
- 2025Mapping Caregiver Needs to AI Chatbot Design: Strengths and Gaps in Mental Health Support for Alzheimer's and Dementia Caregiverscited by 13
- 2026RubRIX: Rubric-Driven Risk Mitigation in Caregiver-AI Interactionscited by 10
- 2025Balancing Caregiving and Self-Care: Exploring Mental Health Needs of Alzheimer's and Dementia Caregiverscited by 7
- 2026Answer Bubbles: Information Exposure in AI-Mediated Searchcited by 3
- 2026ClinicBot: A Guideline-Grounded Clinical Chatbot with Prioritized Evidence RAG and Verifiable Citationscited by 2
- 2026What Users Cannot See: Evaluating LLM Emotional Support Beyond User Preferencecited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026The Supportiveness-Safety Tradeoff in LLM Well-Being Agents
- 2024Development of a Reliable and Accessible Caregiving Language Model (CaLM)
- 2026Auditing Support Strategies in LLMs through Grounded Multi-Turn Social Simulation
- 2025Safe for Whom? Rethinking How We Evaluate the Safety of LLMs for Real Users
- 2025Large Language Model-Powered Conversational Agent Delivering Problem-Solving Therapy (PST) for Family Caregivers: Enhancing Empathy and Therapeutic Alliance Using In-Context Learning
- 2026The Governance of Human-LLM Interaction: Safety Gating, Civility Steering, and Affective Default Lock-In
- 2025Beyond Chat: a Framework for LLMs as Human-Centered Support Systems
- 2025Independent Clinical Evaluation of General-Purpose LLM Responses to Signals of Suicide Risk