RubRIX: Rubric-Driven Risk Mitigation in Caregiver-AI Interactions
Not on the map. Why?
Abstract (arXiv)
Caregivers seeking AI-mediated support express complex needs -- information-seeking, emotional validation, and distress cues -- that warrant careful evaluation of response safety and appropriateness. Existing AI evaluation frameworks, primarily focused on general risks (toxicity, hallucinations, policy violations, etc), may not adequately capture the nuanced risks of LLM-responses in caregiving-contexts. We introduce RubRIX (Rubric-based Risk Index), a theory-driven, clinician-validated framework for evaluating risks in LLM caregiving responses. Grounded in the Elements of an Ethic of Care, RubRIX operationalizes five empirically-derived risk dimensions: Inattention, Bias & Stigma, Information Inaccuracy, Uncritical Affirmation, and Epistemic Arrogance. We evaluate six state-of-the-art LLMs on over 20,000 caregiver queries from Reddit and ALZConnected. Rubric-guided refinement consistently reduced risk-components by 45-98% after one iteration across models. This work contributes a methodological approach for developing domain-sensitive, user-centered evaluation frameworks for high-burden contexts. Our findings highlight the importance of domain-sensitive, interactional risk evaluation for the responsible deployment of LLMs in caregiving support contexts. We release benchmark datasets to enable future research on contextual risk evaluation in AI-mediated support.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 18 of its 63 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
18 of 63 references.
References · 18
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
- 2018Model Cards for Model Reportingcited by 1,080
- 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 384
- 2021Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approachcited by 75
- 2023Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Datacited by 66
- 2023Benefits and Harms of Large Language Models in Digital Mental Healthcited by 40
- 2024SLM-Mod: Small Language Models Surpass LLMs at Content Moderationcited by 27
- 2024From Lived Experience to Insight: Unpacking the Psychological Risks of Using AI Conversational Agentscited by 25
- 2025AI Chatbots for Mental Health: Values and Harms from Lived Experiences of Depressioncited by 13
6 more
- 2025MoMoE: Mixture of Moderation Experts Framework for AI-Assisted Online Governancecited by 13
- 2025Mapping Caregiver Needs to AI Chatbot Design: Strengths and Gaps in Mental Health Support for Alzheimer's and Dementia Caregiverscited by 13
- 2023Mental Health Coping Stories on Social Media: A Causal-Inference Study of Papageno Effectcited by 12
- 2025Balancing Caregiving and Self-Care: Exploring Mental Health Needs of Alzheimer's and Dementia Caregiverscited by 7
- 2025Linguistic Comparison of AI- and Human-Written Responses to Online Mental Health Queriescited by 6
- 2025Interpersonal Theory of Suicide as a Lens to Examine Suicidal Ideation in Online Spacescited by 5
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026AI Psychosis: Does Conversational AI Amplify Delusion-Related Language?cited by 5
- 2026Causal Stories from Sensor Traces: Auditing Epistemic Overreach in LLM-Generated Personal Sensing Explanationscited by 2
- 2026Inform, Coach, Relate, Listen: Auditing LLM Caregiving Support Rolescited by 2
- 2026A Taxonomy of Mental Health and Technology Needs for Alzheimer's and Dementia Caregiverscited by 1
- 2026Sima AIunty: Caste Audit in LLM-Driven Matchmakingcited by 0
- 2026AI Content Moderation in Therapy Conversationscited by 0
- 2026Toxic HallucinAItions: Perturbing Prompts and Tracing LLM Circuitscited by 0
- 2026When AI Says "I have been in similar situations": Synthetic Lived Experience in Peer-Like Caregiver Supportcited by 0
- 2026PeerPen: AI-Assisted Writing for Online Mental Health Peer Supportcited by 0
- 2026CareMirror: Bringing Caregiver Wellbeing into the Dementia Care Ecosystemcited by 0
- 2026CareMirror: Bringing Caregiver Wellbeing into the Dementia Care Ecosystem15 Sep 2026
- 2026PeerPen: AI-Assisted Writing for Online Mental Health Peer Support14 Sep 2026
- 2026A Taxonomy of Mental Health and Technology Needs for Alzheimer's and Dementia Caregivers17 Jun 2026
- 2026When AI Says "I have been in similar situations": Synthetic Lived Experience in Peer-Like Caregiver Support16 Jun 2026
- 2026Toxic HallucinAItions: Perturbing Prompts and Tracing LLM Circuits29 May 2026
- 2026Inform, Coach, Relate, Listen: Auditing LLM Caregiving Support Roles28 May 2026
- 2026AI Content Moderation in Therapy Conversations25 May 2026
- 2026Causal Stories from Sensor Traces: Auditing Epistemic Overreach in LLM-Generated Personal Sensing Explanations9 May 2026
- 2026Sima AIunty: Caste Audit in LLM-Driven Matchmaking31 Mar 2026
- 2026AI Psychosis: Does Conversational AI Amplify Delusion-Related Language?20 Mar 2026