SIC-Agents: Benchmarking and Building an Adaptive Simulator for Pediatric Serious Illness Communication Training
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Pediatric serious illness communication (SIC) is critically important, yet scalable communication training for clinicians remains limited. Compared with other dialogue simulation settings, pediatric SIC poses additional challenges, including multi-party interactions, response to parental distress and strong dependence on feedback dynamics. Existing LLM-based simulators optimize generic dialogue quality rather than curriculum-contingent behavior required for effective SIC training. In collaboration with educators and pediatric clinicians, we introduce the first benchmark suite and simulation framework tailored to pediatric SIC training. Our benchmarks, PitfallBench and DialogueBench, evaluate simulators both at the turn-level and across full dialogues. We further propose SIC-Agents, a self-improving framework that generates a clinician-editable skill document to guide simulator behavior. Our experiments show that SIC-Agents outperforms static expert prompting. To support future research, we release our benchmarks for parent simulation in pediatric SIC at https://github.com/Beikewzh/sic-benchmarks
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 10 of its 45 references that are in the map. First posted on arXiv 30 Aug 2026.
Builds on
10 of 45 references.
References · 10
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 531
- 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
- 2025PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactionscited by 30
- 2025AI Standardized Patient Improves Human Conversations in Advanced Cancer Carecited by 2
- 2025PAL: Designing Conversational Agents as Scalable, Cooperative Patient Simulators for Palliative-Care Trainingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SafeTalkCoach: Diversity-Driven Multi-Agent Simulation for Parent-Teen Health Conversations
- 2025Controlled Yet Natural: A Hybrid BDI-LLM Conversational Agent for Child Helpline Training
- 2025MATRIX: Multi-Agent simulaTion fRamework for safe Interactions and conteXtual clinical conversational evaluation
- 2025AI Agents for Conversational Patient Triage: Preliminary Simulation-Based Evaluation with Real-World EHR Data
- 2025An Agentic AI Framework for Training General Practitioner Student Skills
- 2026Evaluating Scaffolding-Oriented Multi-Agent Large Language Model System for Clinical Interview Training
- 2026Evaluating Large Language Models in Dynamic Clinical Decision-Making with Standardized Patient Cases
- 2025AutoMedic: An Automated Evaluation Framework for Clinical Conversational Agents with Medical Dataset Grounding