NoteChat: A Dataset of Synthetic Doctor-Patient Conversations Conditioned on Clinical Notes
Not on the map. Why?
Abstract (arXiv)
We introduce NoteChat, a novel cooperative multi-agent framework leveraging Large Language Models (LLMs) to generate patient-physician dialogues. NoteChat embodies the principle that an ensemble of role-specific LLMs, through structured role-play and strategic prompting, can perform their assigned roles more effectively. The synergy among these role-playing LLMs results in a cohesive and efficient dialogue generation. Evaluation on MTS-dialogue, a benchmark dataset for patient-physician dialogues-note pairs, shows that models trained with the augmented synthetic patient-physician dialogues by NoteChat outperforms other state-of-the-art models for generating clinical notes. Our comprehensive automatic and human evaluation demonstrates that NoteChat substantially surpasses state-of-the-art models like ChatGPT and GPT-4 up to 22.78% by domain experts in generating superior synthetic patient-physician dialogues based on clinical notes. NoteChat has the potential to engage patients directly and help clinical documentation, a leading cause of physician burnout.
Key facts. Cited by 48 papers in the map (data through 14 Oct 2026). Builds on 25 of its 71 references that are in the map. First posted on arXiv 24 Oct 2023.
Builds on
25 of 71 references.
References · 25
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
- 2022News Summarization and Evaluation in the Era of GPT-3cited by 327
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 318
- 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 312
- 2019Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answeringcited by 147
- 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 131
- 2023Human-like Summarization Evaluation with ChatGPTcited by 126
13 more
- 2023ACI-BENCH: a Novel Ambient Clinical Intelligence Dataset for Benchmarking Automatic Visit Note Generationcited by 118
- 2020Generating SOAP Notes from Doctor-Patient Conversations Using Modular Summarization Techniquescited by 64
- 2022SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarizationcited by 61
- 2021Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarizationcited by 51
- 2021Launching into clinical space with medspaCy: a new clinical text processing toolkit in Pythoncited by 40
- 2021Evidentiality-guided Generation for Knowledge-Intensive NLP Taskscited by 40
- 2023PaniniQA: Enhancing Patient Education Through Interactive Question Answeringcited by 21
- 2023A Meta-Evaluation of Faithfulness Metrics for Long-Form Hospital-Course Summarizationcited by 14
- 2021Improving Formality Style Transfer with Context-Aware Rule Injectioncited by 13
- 2023Causality-aware Concept Extraction based on Knowledge-guided Promptingcited by 8
- 2022Secure Multiparty Computation for Synthetic Data Generation from Distributed Datacited by 6
- 2022Automated Identification of Eviction Status from Electronic Health Record Notescited by 6
- 2023When Crowd Meets Persona: Creating a Large-Scale Open-Domain Persona Dialogue Corpuscited by 5
Built on by
Citing papers per year: 2023: 4; 2024: 11; 2025: 14; 2026: 19.
48 papers.
Sort:
By area:
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2024JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering Capabilitycited by 32
- 2023BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processingcited by 25
- 2024Data Extraction Attacks in Retrieval-Augmented Generation via Backdoorscited by 23
- 2024MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotationscited by 22
- 2024Large Language Model Benchmarks in Medical Taskscited by 17
- 2024MDD-5k: A New Diagnostic Conversation Dataset for Mental Disorders Synthesized via Neuro-Symbolic LLM Agentscited by 16
- 20253MDBench: Medical Multimodal Multi-agent Dialogue Benchmarkcited by 16
- 2024Synthetic Patient-Physician Dialogue Generation from Clinical Notes Using LLMcited by 15
- 2024SYNFAC-EDIT: Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarizationcited by 12
- 2024Towards Adapting Open-Source Large Language Models for Expert-Level Clinical Note Generationcited by 9
- 2025Enhanced Large Language Models for Effective Screening of Depression and Anxietycited by 9
36 more
- 2025Adaptive-VP: A Framework for LLM-Based Virtual Patients that Adapts to Trainees' Dialogue to Facilitate Nurse Communication Trainingcited by 9
- 2024MEDSAGE: Enhancing Robustness of Medical Dialogue Summarization to ASR Errors with LLM-generated Synthetic Dialoguescited by 8
- 2024Improving Clinical Note Generation from Complex Doctor-Patient Conversationcited by 7
- 2025Empowering Healthcare Practitioners with Language Models: Structuring Speech Transcripts in Two Real-World Clinical Applicationscited by 7
- 2025HamRaz: A Culture-Based Persian Conversation Dataset for Person-Centered Therapy Using LLM Agentscited by 6
- 2023EHRTutor: Enhancing Patient Understanding of Discharge Instructionscited by 4
- 2025Synthetic vs. Gold: The Role of LLM Generated Labels and Data in Cyberbullying Detectioncited by 4
- 2025CliniChat: A Multi-Source Knowledge-Driven Framework for Clinical Interview Dialogue Reconstruction and Evaluationcited by 4
- 2026TARSE: Test-Time Adaptation via Retrieval of Skills and Experience for Reasoning Agentscited by 4
- 2026Generating Synthetic Doctor-Patient Conversations for Long-form Audio Summarizationcited by 4
- 2024Synth-SBDH: A Synthetic Dataset of Social and Behavioral Determinants of Health for Clinical Textcited by 3
- 2025A Scoping Review of Synthetic Data Generation by Language Models in Biomedical Research and Application: Data Utility and Quality Perspectivescited by 3
- 2025Optimizing Long-Form Clinical Text Generation with Claim-Based Rewardscited by 3
- 2026Synthesis and Evaluation of Long-term History-aware Medical Dialoguecited by 3
- 2023Do Physicians Know How to Prompt? The Need for Automatic Prompt Optimization Help in Clinical Note Generationcited by 2
- 2025MedPI: Evaluating AI Systems in Medical Patient-facing Interactionscited by 2
- 2026TriageSim: A Conversational Emergency Triage Simulation Framework from Structured Electronic Health Recordscited by 2
- 2026EMSDialog: Synthetic Multi-person Emergency Medical Service Dialogue Generation from Electronic Patient Care Reports via Multi-LLM Agentscited by 2
- 2025A Typology of Synthetic Datasets for Dialogue Processing in Clinical Contextscited by 1
- 2025Why Synthetic Isn't Real Yet: A Diagnostic Framework for Contact Center Dialogue Generationcited by 1
- 2026MedAidDialog: A Multilingual Multi-Turn Medical Dialogue Dataset for Accessible Healthcarecited by 1
- 2023EHR Interaction Between Patients and AI: NoteAid EHR Interactioncited by 0
- 2025EduDial: Constructing a Large-scale Multi-turn Teacher-Student Dialogue Corpuscited by 0
- 2026SafeTalkCoach: Diversity-Driven Multi-Agent Simulation for Parent-Teen Health Conversationscited by 0
- 2026Rethinking Patient Education as Multi-turn Multi-modal Interactioncited by 0
- 2026IndicMedDialog: A Parallel Multi-Turn Medical Dialogue Dataset for Accessible Healthcare in Indic Languagescited by 0
- 2026Systematic Evaluation of the Quality of Synthetic Clinical Notes Rephrased by LLMs at Million-Note Scalecited by 0
- 2026StoryMI: Steerable Multi-Agent Therapeutic Dialogue Generationcited by 0
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognitioncited by 0
- 2026Are LLMs Ready to Assist Physicians? PhysAssistBench for Interactive Doctor-Patient-EHR Assistancecited by 0
- 2026A French OSCE Dialogue Dataset and Controllable Virtual Patient System for Clinical Trainingcited by 0
- 2026SIMAX: A Scalable and Interpretable Framework for Multi-Fidelity and Annotated Clinician-Patient Dialogue Simulationcited by 0
- 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studiescited by 0
- 2026ELICITED: EHR-grounded Longitudinal Interactive Conversations for Information-seeking Triage Evaluation and Decision-makingcited by 0
- 2026AnchorSIPS: A Synthetic Dataset and Evaluation Resource for Evidence-Supported Psychosis-Risk Symptom Measurementcited by 0
- 2026Speech-to-SOAP: End-to-End Summarization of Medical Dialogues: KIT@BeTraC 2026cited by 0
- 2026Speech-to-SOAP: End-to-End Summarization of Medical Dialogues: KIT@BeTraC 202625 Aug 2026
- 2026ELICITED: EHR-grounded Longitudinal Interactive Conversations for Information-seeking Triage Evaluation and Decision-making10 Aug 2026
- 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studies6 Aug 2026
- 2026SIMAX: A Scalable and Interpretable Framework for Multi-Fidelity and Annotated Clinician-Patient Dialogue Simulation29 Jun 2026
- 2026A French OSCE Dialogue Dataset and Controllable Virtual Patient System for Clinical Training26 Jun 2026
- 2026Are LLMs Ready to Assist Physicians? PhysAssistBench for Interactive Doctor-Patient-EHR Assistance17 Jun 2026
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognition12 Jun 2026
- 2026AnchorSIPS: A Synthetic Dataset and Evaluation Resource for Evidence-Supported Psychosis-Risk Symptom Measurement1 Jun 2026
- 2026Synthesis and Evaluation of Long-term History-aware Medical Dialogue19 May 2026
- 2026Systematic Evaluation of the Quality of Synthetic Clinical Notes Rephrased by LLMs at Million-Note Scale18 May 2026
- 2026IndicMedDialog: A Parallel Multi-Turn Medical Dialogue Dataset for Accessible Healthcare in Indic Languages13 May 2026
- 2026StoryMI: Steerable Multi-Agent Therapeutic Dialogue Generation18 Apr 2026
36 more
- 2026Rethinking Patient Education as Multi-turn Multi-modal Interaction16 Apr 2026
- 2026EMSDialog: Synthetic Multi-person Emergency Medical Service Dialogue Generation from Electronic Patient Care Reports via Multi-LLM Agents8 Apr 2026
- 2026Generating Synthetic Doctor-Patient Conversations for Long-form Audio Summarization7 Apr 2026
- 2026MedAidDialog: A Multilingual Multi-Turn Medical Dialogue Dataset for Accessible Healthcare25 Mar 2026
- 2026TriageSim: A Conversational Emergency Triage Simulation Framework from Structured Electronic Health Records2 Mar 2026
- 2026TARSE: Test-Time Adaptation via Retrieval of Skills and Experience for Reasoning Agents1 Mar 2026
- 2026SafeTalkCoach: Diversity-Driven Multi-Agent Simulation for Parent-Teen Health Conversations14 Jan 2026
- 2025MedPI: Evaluating AI Systems in Medical Patient-facing Interactions2 Dec 2025
- 2025EduDial: Constructing a Large-scale Multi-turn Teacher-Student Dialogue Corpus14 Oct 2025
- 2025Optimizing Long-Form Clinical Text Generation with Claim-Based Rewards26 Sep 2025
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025
- 2025Why Synthetic Isn't Real Yet: A Diagnostic Framework for Contact Center Dialogue Generation25 Aug 2025
- 2025Empowering Healthcare Practitioners with Language Models: Structuring Speech Transcripts in Two Real-World Clinical Applications7 Jul 2025
- 2025A Scoping Review of Synthetic Data Generation by Language Models in Biomedical Research and Application: Data Utility and Quality Perspectives19 Jun 2025
- 2025Adaptive-VP: A Framework for LLM-Based Virtual Patients that Adapts to Trainees' Dialogue to Facilitate Nurse Communication Training31 May 2025
- 2025A Typology of Synthetic Datasets for Dialogue Processing in Clinical Contexts5 May 2025
- 2025CliniChat: A Multi-Source Knowledge-Driven Framework for Clinical Interview Dialogue Reconstruction and Evaluation14 Apr 2025
- 20253MDBench: Medical Multimodal Multi-agent Dialogue Benchmark26 Mar 2025
- 2025Synthetic vs. Gold: The Role of LLM Generated Labels and Data in Cyberbullying Detection21 Feb 2025
- 2025HamRaz: A Culture-Based Persian Conversation Dataset for Person-Centered Therapy Using LLM Agents9 Feb 2025
- 2025Enhanced Large Language Models for Effective Screening of Depression and Anxiety15 Jan 2025
- 2024Data Extraction Attacks in Retrieval-Augmented Generation via Backdoors3 Nov 2024
- 2024Large Language Model Benchmarks in Medical Tasks28 Oct 2024
- 2024MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotations18 Oct 2024
- 2024Improving Clinical Note Generation from Complex Doctor-Patient Conversation26 Aug 2024
- 2024MEDSAGE: Enhancing Robustness of Medical Dialogue Summarization to ASR Errors with LLM-generated Synthetic Dialogues26 Aug 2024
- 2024MDD-5k: A New Diagnostic Conversation Dataset for Mental Disorders Synthesized via Neuro-Symbolic LLM Agents22 Aug 2024
- 2024Synthetic Patient-Physician Dialogue Generation from Clinical Notes Using LLM12 Aug 2024
- 2024Synth-SBDH: A Synthetic Dataset of Social and Behavioral Determinants of Health for Clinical Text10 Jun 2024
- 2024Towards Adapting Open-Source Large Language Models for Expert-Level Clinical Note Generation25 Apr 2024
- 2024JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering Capability27 Feb 2024
- 2024SYNFAC-EDIT: Synthetic Imitation Edit Feedback for Factual Alignment in Clinical Summarization21 Feb 2024
- 2023EHR Interaction Between Patients and AI: NoteAid EHR Interaction29 Dec 2023
- 2023Do Physicians Know How to Prompt? The Need for Automatic Prompt Optimization Help in Clinical Note Generation16 Nov 2023
- 2023BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing30 Oct 2023
- 2023EHRTutor: Enhancing Patient Understanding of Discharge Instructions30 Oct 2023
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2024MDD-5k: A New Diagnostic Conversation Dataset for Mental Disorders Synthesized via Neuro-Symbolic LLM Agentscited by 16
- 2025HamRaz: A Culture-Based Persian Conversation Dataset for Person-Centered Therapy Using LLM Agentscited by 6
- 2026SafeTalkCoach: Diversity-Driven Multi-Agent Simulation for Parent-Teen Health Conversationscited by 0
- 2026StoryMI: Steerable Multi-Agent Therapeutic Dialogue Generationcited by 0
- 2026StoryMI: Steerable Multi-Agent Therapeutic Dialogue Generation18 Apr 2026
- 2026SafeTalkCoach: Diversity-Driven Multi-Agent Simulation for Parent-Teen Health Conversations14 Jan 2026
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers28 Aug 2025
- 2025HamRaz: A Culture-Based Persian Conversation Dataset for Person-Centered Therapy Using LLM Agents9 Feb 2025
- 2024MDD-5k: A New Diagnostic Conversation Dataset for Mental Disorders Synthesized via Neuro-Symbolic LLM Agents22 Aug 2024
- 2024Synth-SBDH: A Synthetic Dataset of Social and Behavioral Determinants of Health for Clinical Textcited by 3
- 2025A Scoping Review of Synthetic Data Generation by Language Models in Biomedical Research and Application: Data Utility and Quality Perspectivescited by 3
- 2026AnchorSIPS: A Synthetic Dataset and Evaluation Resource for Evidence-Supported Psychosis-Risk Symptom Measurementcited by 0
- 2026AnchorSIPS: A Synthetic Dataset and Evaluation Resource for Evidence-Supported Psychosis-Risk Symptom Measurement1 Jun 2026
- 2025A Scoping Review of Synthetic Data Generation by Language Models in Biomedical Research and Application: Data Utility and Quality Perspectives19 Jun 2025
- 2024Synth-SBDH: A Synthetic Dataset of Social and Behavioral Determinants of Health for Clinical Text10 Jun 2024
- 20253MDBench: Medical Multimodal Multi-agent Dialogue Benchmarkcited by 16
- 20253MDBench: Medical Multimodal Multi-agent Dialogue Benchmark26 Mar 2025
- 2023BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processingcited by 25
- 2024MediTOD: An English Dialogue Dataset for Medical History Taking with Comprehensive Annotationscited by 22
- 2024Large Language Model Benchmarks in Medical Taskscited by 17
- 2024Synthetic Patient-Physician Dialogue Generation from Clinical Notes Using LLMcited by 15
- 2024Towards Adapting Open-Source Large Language Models for Expert-Level Clinical Note Generationcited by 9
- 2025Enhanced Large Language Models for Effective Screening of Depression and Anxietycited by 9
- 2025Adaptive-VP: A Framework for LLM-Based Virtual Patients that Adapts to Trainees' Dialogue to Facilitate Nurse Communication Trainingcited by 9
- 2024MEDSAGE: Enhancing Robustness of Medical Dialogue Summarization to ASR Errors with LLM-generated Synthetic Dialoguescited by 8
- 2024Improving Clinical Note Generation from Complex Doctor-Patient Conversationcited by 7
- 2025Empowering Healthcare Practitioners with Language Models: Structuring Speech Transcripts in Two Real-World Clinical Applicationscited by 7
- 2023EHRTutor: Enhancing Patient Understanding of Discharge Instructionscited by 4
- 2025Synthetic vs. Gold: The Role of LLM Generated Labels and Data in Cyberbullying Detectioncited by 4
12 most cited of 33 All 33 (JSON)
- 2026Speech-to-SOAP: End-to-End Summarization of Medical Dialogues: KIT@BeTraC 202625 Aug 2026
- 2026ELICITED: EHR-grounded Longitudinal Interactive Conversations for Information-seeking Triage Evaluation and Decision-making10 Aug 2026
- 2026Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studies6 Aug 2026
- 2026SIMAX: A Scalable and Interpretable Framework for Multi-Fidelity and Annotated Clinician-Patient Dialogue Simulation29 Jun 2026
- 2026A French OSCE Dialogue Dataset and Controllable Virtual Patient System for Clinical Training26 Jun 2026
- 2026Are LLMs Ready to Assist Physicians? PhysAssistBench for Interactive Doctor-Patient-EHR Assistance17 Jun 2026
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognition12 Jun 2026
- 2026Synthesis and Evaluation of Long-term History-aware Medical Dialogue19 May 2026
- 2026Systematic Evaluation of the Quality of Synthetic Clinical Notes Rephrased by LLMs at Million-Note Scale18 May 2026
- 2026IndicMedDialog: A Parallel Multi-Turn Medical Dialogue Dataset for Accessible Healthcare in Indic Languages13 May 2026
- 2026Rethinking Patient Education as Multi-turn Multi-modal Interaction16 Apr 2026
- 2026EMSDialog: Synthetic Multi-person Emergency Medical Service Dialogue Generation from Electronic Patient Care Reports via Multi-LLM Agents8 Apr 2026
12 newest of 33 All 33 (JSON)