WangLab at MEDIQA-Chat 2023: Clinical Note Generation from Doctor-Patient Conversations using Large Language Models
Not on the map. Why?
Abstract (arXiv)
This paper describes our submission to the MEDIQA-Chat 2023 shared task for automatic clinical note generation from doctor-patient conversations. We report results for two approaches: the first fine-tunes a pre-trained language model (PLM) on the shared task data, and the second uses few-shot in-context learning (ICL) with a large language model (LLM). Both achieve high performance as measured by automatic metrics (e.g. ROUGE, BERTScore) and ranked second and first, respectively, of all submissions to the shared task. Expert human scrutiny indicates that notes generated via the ICL-based approach with GPT-4 are preferred about as often as human-written notes, making it a promising path toward automated note generation from doctor-patient conversations.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 20 of its 36 references that are in the map. First posted on arXiv 3 May 2023.
Builds on
20 of 36 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2023GPT-4 Technical Reportcited by 18,132
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
- 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 329
- 2021Learning Compact Metrics for MTcited by 93
- 2021Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarizationcited by 76
8 more
- 2020Generating SOAP Notes from Doctor-Patient Conversations Using Modular Summarization Techniquescited by 64
- 2020Dr. Summarize: Global Summarization of Medical Dialogue by Exploiting Local Structurescited by 49
- 2021Leveraging Pretrained Models for Automatic Summarization of Doctor-Patient Conversationscited by 42
- 2022Re-Examining System-Level Correlations of Automatic Summarization Evaluation Metricscited by 37
- 2022Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generationcited by 33
- 2022PriMock57: A Dataset Of Primary Care Mock Consultationscited by 30
- 2022User-Driven Research of Medical Note Generation Softwarecited by 13
- 2022Consultation Checklists: Standardising the Human Evaluation of Medical Note Generationcited by 8
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 2; 2026: 1.
7 papers.
- 2023Large language models in healthcare and medical domain: A reviewcited by 126
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2024CLINICSUM: Utilizing Language Models for Generating Clinical Summaries from Patient-Doctor Conversationscited by 7
- 2025Automated Survey Collection with LLM-based Conversational Agentscited by 6
- 2024WangLab at MEDIQA-CORR 2024: Optimized LLM-based Programs for Medical Error Detection and Correctioncited by 4
- 2025Are LLMs reliable? An exploration of the reliability of large language models in clinical note generationcited by 2
- 2026DocTalkBN: A Novel Dataset of Expert Telemedicine Conversations in Bengalicited by 0
- 2026DocTalkBN: A Novel Dataset of Expert Telemedicine Conversations in Bengali27 Aug 2026
- 2025Are LLMs reliable? An exploration of the reliability of large language models in clinical note generation21 May 2025
- 2025Automated Survey Collection with LLM-based Conversational Agents2 Apr 2025
- 2024CLINICSUM: Utilizing Language Models for Generating Clinical Summaries from Patient-Doctor Conversations5 Dec 2024
- 2024WangLab at MEDIQA-CORR 2024: Optimized LLM-based Programs for Medical Error Detection and Correction22 Apr 2024
- 2023Large language models in healthcare and medical domain: A review12 Dec 2023
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-44 Oct 2023