MindGuard: Guardrail Classifiers for Multi-Turn Mental Health Support
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
Large language models are increasingly used for mental health support, yet their conversational coherence alone does not ensure clinical appropriateness. Existing general-purpose safeguards often fail to distinguish between therapeutic disclosures and genuine clinical crises, leading to safety failures. To address this gap, we introduce a clinically grounded risk taxonomy, developed in collaboration with PhD-level psychologists, that identifies actionable harm (e.g., self-harm and harm to others) while preserving space for safe, non-crisis therapeutic content. We release MindGuard-testset, a dataset of real-world multi-turn conversations annotated at the turn level by clinical experts. Using synthetic dialogues generated via a controlled two-agent setup, we train MindGuard, a family of lightweight safety classifiers (with 4B and 8B parameters). Our classifiers reduce false positives at high-recall operating points and, when paired with clinician language models, help achieve lower attack success and harmful engagement rates in adversarial multi-turn interactions compared to general-purpose safeguards. We release all models and human evaluation data.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 8 of its 24 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
8 of 24 references.
References · 8
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2025Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teamingcited by 172
- 2025Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providerscited by 67
- 2024The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationshipscited by 61
- 2025PolyGuard: A Multilingual Safety Moderation Tool for 17 Languagescited by 57
- 2025Investigating Affective Use and Emotional Well-being on ChatGPTcited by 36
- 2025Technological folie `a deux: Feedback Loops Between AI Chatbots and Mental Illnesscited by 14
Built on by
Citing papers per year: 2026: 2.
2 papers.