mlsanityData to 14 Oct 2026

CPEMH: An Agentic Framework for Prompt-Driven Behavior Evaluation and Assurance in Foundation-Model Systems for Mental Health Screening

arXiv 2605.11341 ↗First posted 11 May 2026cs.AIcited by 0

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

This paper presents CPEMH, an agentic framework designed to evaluate prompt-driven behavior in foundation-model systems operating on transcript-based datasets for mental-health screening. CPEMH serves as an engineering methodology for behavioral assurance in large-scale language systems, introducing an orchestrated architecture that autonomously performs the design, evaluation, and selection of prompt strategies, enabling systematic control of behavioral variability across contexts. Its modular agentic design, combining orchestrator, inference, and evaluation agents, ensures traceability, reproducibility, and robustness throughout the prompting lifecycle. A case study on automated depression screening from interview transcripts demonstrates the framework's capacity to stabilize and audit foundation-model behavior in conversational and clinically sensitive domains. Lessons learned emphasize the role of modular orchestration in behavioral assurance, the prioritization of stability over architectural complexity, and the integration of F1, bias, and robustness as core acceptance criteria.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 6 of its 22 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

6 of 22 references.

References · 6

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,392
  3. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  4. 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 425
  5. 2023Self-collaboration Code Generation via ChatGPTcited by 258
  6. 2023Teach AI How to Code: Using Large Language Models as Teachable Agents for Programming Educationcited by 39

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026An Agentic LLM-Based Framework for Population-Scale Mental Health Screening
  2. 2025MAGI: Multi-Agent Guided Interview for Psychiatric Assessment
  3. 2026A Multi-Agent Audit Framework for High-Stakes Reasoning: Evaluation and Interpretability in Clinical Mental Health Screening
  4. 2026PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Support
  5. 2026Towards Efficient and Robust Linguistic Emotion Diagnosis for Mental Health via Multi-Agent Instruction Refinement
  6. 2026PsyCIDRA: A Dual-Agent Framework for Psychiatric Interviewing and Diagnostic Reasoning
  7. 2025MindEval: Benchmarking Language Models on Multi-turn Mental Health Support
  8. 2026Training Therapeutic Judges and Multi-Agent Systems for Human-Aligned Mental Health Support