mlsanityData to 14 Oct 2026

RubRIX: Rubric-Driven Risk Mitigation in Caregiver-AI Interactions

arXiv 2601.13235 ↗First posted 19 Jan 2026cs.HC cs.AI cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

Caregivers seeking AI-mediated support express complex needs -- information-seeking, emotional validation, and distress cues -- that warrant careful evaluation of response safety and appropriateness. Existing AI evaluation frameworks, primarily focused on general risks (toxicity, hallucinations, policy violations, etc), may not adequately capture the nuanced risks of LLM-responses in caregiving-contexts. We introduce RubRIX (Rubric-based Risk Index), a theory-driven, clinician-validated framework for evaluating risks in LLM caregiving responses. Grounded in the Elements of an Ethic of Care, RubRIX operationalizes five empirically-derived risk dimensions: Inattention, Bias & Stigma, Information Inaccuracy, Uncritical Affirmation, and Epistemic Arrogance. We evaluate six state-of-the-art LLMs on over 20,000 caregiver queries from Reddit and ALZConnected. Rubric-guided refinement consistently reduced risk-components by 45-98% after one iteration across models. This work contributes a methodological approach for developing domain-sensitive, user-centered evaluation frameworks for high-burden contexts. Our findings highlight the importance of domain-sensitive, interactional risk evaluation for the responsible deployment of LLMs in caregiving support contexts. We release benchmark datasets to enable future research on contextual risk evaluation in AI-mediated support.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 18 of its 63 references that are in the map. First posted on arXiv 19 Jan 2026.

Builds on

18 of 63 references.

References · 18

  1. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  2. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  3. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
  4. 2018Model Cards for Model Reportingcited by 1,080
  5. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 736
  6. 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 384
  7. 2021Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approachcited by 75
  8. 2023Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Datacited by 66
  9. 2023Benefits and Harms of Large Language Models in Digital Mental Healthcited by 40
  10. 2024SLM-Mod: Small Language Models Surpass LLMs at Content Moderationcited by 27
  11. 2024From Lived Experience to Insight: Unpacking the Psychological Risks of Using AI Conversational Agentscited by 25
  12. 2025AI Chatbots for Mental Health: Values and Harms from Lived Experiences of Depressioncited by 13
6 more
  1. 2025MoMoE: Mixture of Moderation Experts Framework for AI-Assisted Online Governancecited by 13
  2. 2025Mapping Caregiver Needs to AI Chatbot Design: Strengths and Gaps in Mental Health Support for Alzheimer's and Dementia Caregiverscited by 13
  3. 2023Mental Health Coping Stories on Social Media: A Causal-Inference Study of Papageno Effectcited by 12
  4. 2025Balancing Caregiving and Self-Care: Exploring Mental Health Needs of Alzheimer's and Dementia Caregiverscited by 7
  5. 2025Linguistic Comparison of AI- and Human-Written Responses to Online Mental Health Queriescited by 6
  6. 2025Interpersonal Theory of Suicide as a Lens to Examine Suicidal Ideation in Online Spacescited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.