When Vocabulary Comprehension Fails Clinical Reasoning: Evaluating Therapy Bots' Safety Risks for Generation Alpha
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Conversational AI systems have become informal mental health support resources for Generation Alpha (Gen Alpha, born 2010-2024), with 13.1% of U.S. adolescents (5.4 million) using generative AI for mental health advice. While these systems, from therapy apps to general chatbots, rely on large language models trained on extensive psychological literature, their safety for youth communication patterns characterized by hyperbolic language, ironic positivity, rapid semantic drift, and contextual polysemy remains unvalidated. Following multiple adolescent deaths linked to AI chatbot interactions, systematic evaluation is critical. We present two benchmarks: (1) 64 Gen Alpha mental health expressions validated by native speakers (ICC=0.72) and clinicians (kappa=0.78); (2) 75 multi-turn conversations (780 turns) with paired Standard/Gen Alpha versions. Across evaluations of LLM architectures underlying therapy apps and general chatbots - Claude, GPT-4o, Llama-3.1 - models understand 76-82% of vocabulary but correctly calibrate only 64-72% of clinical risk, creating a 10-14 percentage point (pp) vocabulary-comprehension gap (p<.001, d>0.48) absent in human therapists (3pp, p=.22). The gap is architecturally consistent and widens with ambiguity (7pp -> 18pp). We identify six failure patterns: sarcasm masking (29pp), minimization acceptance (43pp), informal style bias (24pp), risk-stratified ambiguity (19pp), semantic drift (19pp), context-dependent violence (7pp). Patterns compound; three or more yield 94% miss rates. Lightweight mitigations fail; only heavy scaffolding achieves human performance (6.4x cost). With 34% baseline miss rate yielding 146,880 estimated annual missed crises, we recommend mandatory human-in-the-loop architectures, quarterly youth-specific validation, transparent performance disclosure, and regulatory frameworks for youth-facing mental health AI.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 10 of its 44 references that are in the map. First posted on arXiv 14 Jun 2026.
Builds on
10 of 44 references.
References · 10
- 2021MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluationcited by 88
- 2025Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providerscited by 69
- 2024Introducing v0.5 of the AI Safety Benchmark from MLCommonscited by 62
- 2025AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommonscited by 35
- 2025When Can We Trust LLMs in Mental Health? Large-Scale Benchmarks for Reliable LLM Evaluationcited by 19
- 2024Aurora-M: Open Source Continual Pre-training for Multilingual Language and Codecited by 10
- 2024Toward Informal Language Processing: Knowledge of Slang in Large Language Modelscited by 6
- 2025Understanding Gen Alpha Digital Language: Evaluation of LLM Safety Systems for Content Moderationcited by 5
- 2025Chronoberg: A 250-Year Diachronic Corpus with Temporal Affective Lexicons for Language Model Analysiscited by 3
- 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Assessing Risks of Large Language Models in Mental Health Support: A Framework for Automated Clinical AI Red Teaming
- 2026Beyond Simulations: What 20,000 Real Conversations Reveal About Mental Health AI Safety
- 2026TherapyGym: Evaluating and Aligning Clinical Fidelity and Safety in Therapy Chatbots
- 2024Toward Safe Evolution of Artificial Intelligence (AI) based Conversational Agents to Support Adolescent Mental and Sexual Health Knowledge Discovery
- 2024Building Trust in Mental Health Chatbots: Safety Metrics and LLM-Based Evaluation Tools
- 2026AI Safety Training Can be Clinically Harmful
- 2025MindEval: Benchmarking Language Models on Multi-turn Mental Health Support
- 2026Beyond "I Can't Help With That": How Child Safety Experts Evaluate AI Chatbot Safety