Learning When to Ask: Simulation-Trained Humanoids for Mental-Health Diagnosis
Not on the map. Why?
Abstract (arXiv)
Testing humanoid robots with users is slow, causes wear, and limits iteration and diversity. Yet screening agents must master conversational timing, prosody, backchannels, and what to attend to in faces and speech for Depression and PTSD. Most simulators omit policy learning with nonverbal dynamics; many controllers chase task accuracy while underweighting trust, pacing, and rapport. We virtualise the humanoid as a conversational agent to train without hardware burden. Our agent-centred, simulation-first pipeline turns interview data into 276 Unreal Engine MetaHuman patients with synchronised speech, gaze/face, and head-torso poses, plus PHQ-8 and PCL-C flows. A perception-fusion-policy loop decides what and when to speak, when to backchannel, and how to avoid interruptions, under a safety shield. Training uses counterfactual replay (bounded nonverbal perturbations) and an uncertainty-aware turn manager that probes to reduce diagnostic ambiguity. Results are simulation-only; the humanoid is the transfer target. In comparing three controllers, a custom TD3 (Twin Delayed DDPG) outperformed PPO and CEM, achieving near-ceiling coverage with steadier pace at comparable rewards. Decision-quality analyses show negligible turn overlap, aligned cut timing, fewer clarification prompts, and shorter waits. Performance stays stable under modality dropout and a renderer swap, and rankings hold on a held-out patient split. Contributions: (1) an agent-centred simulator that turns interviews into 276 interactive patients with bounded nonverbal counterfactuals; (2) a safe learning loop that treats timing and rapport as first-class control variables; (3) a comparative study (TD3 vs PPO/CEM) with clear gains in completeness and social timing; and (4) ablations and robustness analyses explaining the gains and enabling clinician-supervised humanoid pilots.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 44 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
7 of 44 references.
References · 7
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 628
- 2025The Many Challenges of Human-Like Agents in Virtual Game Environmentscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MindEval: Benchmarking Language Models on Multi-turn Mental Health Support
- 2026Stress-Testing Emotional Support Models: Moving from Homogeneous to Diverse Help Seekers
- 2024Body of Her: A Preliminary Study on End-to-End Humanoid Agent
- 2025ESC-Judge: A Framework for Comparing Emotional Support Conversational Agents
- 2024Depression Diagnosis Dialogue Simulation: Self-improving Psychiatrist with Tertiary Memory
- 2025AnnaAgent: Dynamic Evolution Agent System with Multi-Session Memory for Realistic Seeker Simulation
- 2023An Integrative Survey on Mental Health Conversational Agents to Bridge Computer Science and Medical Perspectives
- 2026Mind Companion: An Embodied Conversational Agent for Process-Based Psychotherapy