mlsanityData to 14 Oct 2026

First, Do No Harm: AI Supervisor Scaffolds Novice Growth in Counselor Education

arXiv 2508.09042 ↗First posted 12 Aug 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The most dangerous mistakes a novice counselor makes are not the obvious ones: they are utterances that sound caring while quietly violating professional ethics and leaving vulnerable clients less protected. We build an AI supervisor that does not replace novice counselors, but grows them-teaching them to internalize ethical violations they would otherwise never notice. What makes this supervisor non-trivial is not detection but teaching: it must locate the ethical-violating utterance, diagnose the ethical violation against APA principles, and deliver feedback that explains not just what went wrong, but why it is risky and how to respond differently. The core obstacle is that (1) ethical violations are by nature unlabeled in real clinical data, and (2) existing AI counselors trained only to match correct answers will never learn to teach. We resolve both at once: a controllable AI novice that intentionally enacts predefined mistake categories makes supervision labels a natural byproduct of generation, yielding ETHICSCAFF, a 9,915-instance human-in-the-loop dataset; and GRPO under a Novice Growth Reward (NGR) optimizes the supervisor not for answer correctness but for whether a weaker novice model actually improves after reading its explanation. Experiments show that a novice guided by our supervisor outperforms an unguided peer on clinical metrics, and that teaching-oriented optimization via NGR further sharpens the supervisor's own ethical detection. In a user study with novice counseling-psychology students, participants show significant self-efficacy gains across all eight assessed competencies after receiving AI supervisory feedback, demonstrating that the scaffold transfers from simulation to real-world practice.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 37 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

16 of 37 references.

References · 16

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2021Towards Emotional Support Dialog Systemscited by 299
  4. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
  5. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
  6. 2020A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Supportcited by 182
  7. 2024Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theorycited by 60
  8. 2023Rehearsal: Simulating Conflict to Teach Conflict Resolutioncited by 55
  9. 2024HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapycited by 47
  10. 2024CBT-LLM: A Chinese Large Language Model for Cognitive Behavioral Therapy-based Mental Health Question Answeringcited by 45
  11. 2024Interactive Agents: Simulating Counselor-Client Psychological Counseling via Role-Playing LLM-to-LLM Interactionscited by 43
  12. 2024PsyDT: Using LLMs to Construct the Digital Twin of Psychological Counselor with Personalized Counseling Style for Psychological Counselingcited by 38
4 more
  1. 2024PATIENT-Psi: Using Large Language Models to Simulate Patients for Training Mental Health Professionalscited by 21
  2. 2022COSPLAY: Concept Set Guided Personalized Dialogue Generation Across Both Party Personascited by 20
  3. 2024Multi-Level Feedback Generation with Large Language Models for Empowering Novice Peer Counselorscited by 16
  4. 2025Emotional Support with LLM-based Empathetic Dialogue Generationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Support
  2. 2026Expert Evaluation and the Limits of Human Feedback in Mental Health AI Safety Testing
  3. 2026Beyond "I Can't Help With That": How Child Safety Experts Evaluate AI Chatbot Safety
  4. 2026SafeTutors: Benchmarking Pedagogical Safety in AI Tutoring Systems
  5. 2026TherapyGym: Evaluating and Aligning Clinical Fidelity and Safety in Therapy Chatbots
  6. 2025CAMI: A Counselor Agent Supporting Motivational Interviewing through State Inference and Topic Exploration
  7. 2025A Design Science Blueprint for an Orchestrated AI Assistant in Doctoral Supervision
  8. 2026PsychAgent: An Experience-Driven Lifelong Learning Agent for Self-Evolving Psychological Counselor