mlsanityData to 14 Oct 2026

Mental Health AI Safety Claims Must Preserve Temporal Evidence

arXiv 2605.08827 ↗First posted 9 May 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The safety of mental health AI is often judged at the wrong temporal scale. Current evaluations typically score isolated responses, endpoint outcomes, or aggregate dialogue quality, while clinically consequential failures may arise from the order and accumulation of interactions themselves, including delayed escalation, repeated reinforcement, dependency formation, failed repair, and gradual deterioration across turns. This paper argues that this mismatch is not merely a limitation of evaluation coverage but a source of invalid safety conclusions. We introduce Temporal Safety Non-Identifiability, a formal account of why safety properties that depend on sequence, timing, accumulation, or recovery cannot be certified by protocols that discard those features. From this formalization, we develop SCOPE (Safety Claims Over Preserved Evidence) as a general principle for aligning safety claims with the evidence an evaluation actually retains, and instantiate it as SCOPE-MH, a mental-health instantiation of this reporting standard. We operationalize SCOPE-MH through a proof-of-concept on the AnnoMI dataset of expert-annotated motivational interviewing conversations, which reveals mechanisms of failure that per-turn behavior scoring does not represent. We propose SCOPE-MH as a diagnostic complement to existing evaluation infrastructure and argue that evaluation preserving temporal evidence is necessary, not optional, for safety-critical mental health AI deployment.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 24 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

7 of 24 references.

References · 7

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2025CounselBench: A Large-Scale Expert Evaluation and Adversarial Benchmarking of Large Language Models in Mental Health Question Answeringcited by 21
  3. 2025MindEval: Benchmarking Language Models on Multi-turn Mental Health Supportcited by 10
  4. 2024Building Trust in Mental Health Chatbots: Safety Metrics and LLM-Based Evaluation Toolscited by 9
  5. 2026MHSafeEval: Role-Aware Interaction-Level Evaluation of Mental Health Safety in Large Language Modelscited by 3
  6. 2026MHDash: An Online Platform for Benchmarking Mental Health-Aware AI Assistantscited by 2
  7. 2026EchoGuard: An Agentic Framework with Knowledge-Graph Memory for Detecting Manipulative Communication in Longitudinal Dialoguecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.