ELICITED: EHR-grounded Longitudinal Interactive Conversations for Information-seeking Triage Evaluation and Decision-making
Not on the map. Why?
Abstract (arXiv)
Emergency-department (ED) triage requires clinicians to rapidly identify patients who need immediate attention, determine who can safely wait, and prioritize limited clinical resources. At presentation, however, information may be limited to a chief complaint and initial vital signs. Clinically important details, including symptom onset and progression, associated symptoms, medical history, and medication use, are often obtained through focused conversation. Effective triage therefore requires clinicians to identify information gaps, ask appropriate follow-up questions, and update their assessment as new evidence becomes available. Most existing ED benchmarks evaluate acuity prediction from a fixed clinical snapshot. Although this formulation measures predictive performance after patient information has been assembled, it does not capture the interactive process through which triage-relevant evidence is elicited and interpreted. Existing medical dialogue datasets support the study of clinical communication, but dialogue statements are not always linked to temporally ordered events in the electronic health record (EHR). We introduce EHR2Dial-Triage, an agentic conversation-generation framework and benchmark grounded in MIMIC-IV-ED. The framework constructs triage conversations under explicit role-based and temporal information boundaries. Each accepted patient disclosure is linked to its supporting EHR event and the first dialogue turn at which it becomes available. EHR2Dial-Triage enables controlled evaluation of information elicitation, evidence use, five-level Emergency Severity Index prediction, and patient-facing communication across models and patient personas. It provides a structured setting for studying conversational triage as a dynamic process of clinical information acquisition, reasoning, and communication.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 52 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
24 of 52 references.
References · 24
- 2025Qwen3 Technical Reportcited by 8,195
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2023AWQ: Activation-aware Weight Quantization for LLM Compression and Accelerationcited by 1,234
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
- 2020MedDialog: Two Large-scale Medical Dialogue Datasetscited by 157
- 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 145
- 2022DDXPlus: A New Dataset For Automatic Medical Diagnosiscited by 87
- 2025MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agentscited by 56
- 2023NoteChat: A Dataset of Synthetic Doctor-Patient Conversations Conditioned on Clinical Notescited by 48
- 2022A Benchmark for Automatic Medical Consultation System: Frameworks, Tasks and Datasetscited by 45
- 2026MedGemma 1.5 Technical Reportcited by 43
12 more
- 2021Benchmarking emergency department triage prediction models with machine learning and large public electronic health recordscited by 30
- 2025PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactionscited by 30
- 2024MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotationscited by 21
- 2021ReMeDi: Resources for Multi-domain, Multi-service, Medical Dialoguescited by 20
- 2025Ask Patients with Patience: Enabling LLMs for Human-Centric Medical Dialogue with Grounded Reasoningcited by 19
- 20253MDBench: Medical Multimodal Multi-agent Dialogue Benchmarkcited by 16
- 2024Synthetic Patient-Physician Dialogue Generation from Clinical Notes Using LLMcited by 15
- 2025AI Agents for Conversational Patient Triage: Preliminary Simulation-Based Evaluation with Real-World EHR Datacited by 5
- 2026MeDxAgent: Multi-Agent Consultation for Interactive Medical Diagnosiscited by 4
- 2026TriageSim: A Conversational Emergency Triage Simulation Framework from Structured Electronic Health Recordscited by 2
- 2026Evaluating the Pre-Consultation Ability of LLMs using Diagnostic Guidelinescited by 1
- 2026Note2Chat: Improving LLMs for Multi-Turn Clinical History Taking Using Medical Notescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AcuityBench: Evaluating Clinical Acuity Identification and Uncertainty Alignment
- 2026EMSDialog: Synthetic Multi-person Emergency Medical Service Dialogue Generation from Electronic Patient Care Reports via Multi-LLM Agents
- 2026MedConceal: A Benchmark for Clinical Hidden-Concern Reasoning Under Partial Observability
- 2026Human-LLM Dialogue Improves Diagnostic Accuracy in Emergency Care
- 2025Multi-agent Self-triage System with Medical Flowcharts
- 2025Advancing Conversational Diagnostic AI with Multimodal Reasoning
- 2025ER-Reason: A Benchmark Dataset for LLM Clinical Reasoning in the Emergency Room
- 2026Auditable Emergency Triage for Maternal and Newborn Care in India