mlsanityData to 14 Oct 2026

Domain-Specific Constitutional AI: Enhancing Safety in LLM-Powered Mental Health Chatbots

arXiv 2509.16444 ↗First posted 19 Sep 2025cs.AI cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Mental health applications have emerged as a critical area in computational health, driven by rising global rates of mental illness, the integration of AI in psychological care, and the need for scalable solutions in underserved communities. These include therapy chatbots, crisis detection, and wellness platforms handling sensitive data, requiring specialized AI safety beyond general safeguards due to emotional vulnerability, risks like misdiagnosis or symptom exacerbation, and precise management of vulnerable states to avoid severe outcomes such as self-harm or loss of trust. Despite AI safety advances, general safeguards inadequately address mental health-specific challenges, including crisis intervention accuracy to avert escalations, therapeutic guideline adherence to prevent misinformation, scale limitations in resource-constrained settings, and adaptation to nuanced dialogues where generics may introduce biases or miss distress signals. We introduce an approach to apply Constitutional AI training with domain-specific mental health principles for safe, domain-adapted CAI systems in computational mental health applications.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 14 of its 16 references that are in the map. First posted on arXiv 19 Sep 2025.

Builds on

14 of 16 references.

References · 14

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  4. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
  5. 2024Foundational Challenges in Assuring Alignment and Safety of Large Language Modelscited by 199
  6. 2024Aligner: Efficient Alignment by Learning to Correctcited by 98
  7. 2024Reinforcement Learning for LLM Post-Training: A Surveycited by 92
  8. 2024Building Guardrails for Large Language Modelscited by 65
  9. 2024The opportunities and risks of large language models in mental healthcited by 54
  10. 2023Specific versus General Principles for Constitutional AIcited by 47
  11. 2025MentalChat16K: A Benchmark Dataset for Conversational Mental Health Assistancecited by 39
  12. 2025C3AI: Crafting and Evaluating Constitutions for Constitutional AIcited by 13
2 more
  1. 2024Building Trust in Mental Health Chatbots: Safety Metrics and LLM-Based Evaluation Toolscited by 9
  2. 2025How Effective Is Constitutional AI in Small LLMs? A Study on DeepSeek-R1 and Its Peerscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Simulations: What 20,000 Real Conversations Reveal About Mental Health AI Safety
  2. 2026Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming
  3. 2023An Integrative Survey on Mental Health Conversational Agents to Bridge Computer Science and Medical Perspectives
  4. 2025Envisioning an AI-Enhanced Mental Health Ecosystem
  5. 2025MindEval: Benchmarking Language Models on Multi-turn Mental Health Support
  6. 2025Trustworthy AI Psychotherapy: Multi-Agent LLM Workflow for Counseling and Explainable Mental Disorder Diagnosis
  7. 2024Toward Safe Evolution of Artificial Intelligence (AI) based Conversational Agents to Support Adolescent Mental and Sexual Health Knowledge Discovery
  8. 2026TherapyGym: Evaluating and Aligning Clinical Fidelity and Safety in Therapy Chatbots