mlsanityData to 14 Oct 2026

PULSAR at MEDIQA-Sum 2023: Large Language Models Augmented by Synthetic Dialogue Convert Patient Dialogues to Medical Records

arXiv 2307.02006 ↗First posted 5 Jul 2023cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

This paper describes PULSAR, our system submission at the ImageClef 2023 MediQA-Sum task on summarising patient-doctor dialogues into clinical records. The proposed framework relies on domain-specific pre-training, to produce a specialised language model which is trained on task-specific natural data augmented by synthetic data generated by a black-box LLM. We find limited evidence towards the efficacy of domain-specific pre-training and data augmentation, while scaling up the language model yields the best performance gains. Our approach was ranked second and third among 13 submissions on task B of the challenge. Our code is available at https://github.com/yuping-wu/PULSAR.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 5 Jul 2023.

Builds on

20 of 34 references.

References · 20

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  6. 2022Emergent Abilities of Large Language Modelscited by 2,512
  7. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  8. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  9. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  10. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
  11. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 834
  12. 2022Large Language Models are Few-Shot Clinical Information Extractorscited by 207
8 more
  1. 2021Generating Datasets with Pretrained Language Modelscited by 193
  2. 2023Do We Still Need Clinical Language Models?cited by 98
  3. 2023Large AI Models in Health Informatics: Applications, Challenges, and the Futurecited by 61
  4. 2021A Survey on Dialogue Summarization: Recent Advances and New Frontierscited by 51
  5. 2022Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Codingcited by 40
  6. 2023Mimic-IV-ICD: A new benchmark for eXtreme MultiLabel Classificationcited by 19
  7. 2022Discharge Summary Hospital Course Summarisation of In Patient Electronic Health Record Text with Clinical Concept Guided Deep Pre-Trained Transformer Modelscited by 18
  8. 2023Do You Hear The People Sing? Key Point Analysis via Iterative Clustering and Abstractive Summarisationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 5; 2026: 2.

11 papers.

  1. 2024A Survey on Data Augmentation in Large Model Eracited by 31
  2. 2024Data Augmentation using Large Language Models: Data Perspectives, Learning Paradigms and Challengescited by 30
  3. 2025MIRA: Medical Time Series Foundation Model for Real-World Health Datacited by 22
  4. 2025BRIDGE: Bootstrapping Text to Control Time-Series Generation via Multi-Agent Iterative Optimization and Diffusion Modelingcited by 19
  5. 2023User Modeling in the Era of Large Language Models: Current Research and Future Directionscited by 18
  6. 2024LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMscited by 8
  7. 2025TarDiff: Target-Oriented Diffusion Guidance for Synthetic Electronic Health Record Time Series Generationcited by 8
  8. 2025Generating Realistic Multi-Beat ECG Signalscited by 1
  9. 2025Privacy-Preserving Generation of Clinical Narratives from Medical Terminologiescited by 1
  10. 2026SOTER: A Generative Time-Series Foundation Model for Wearable Human Physiological Signalscited by 1
  11. 2026DocTalkBN: A Novel Dataset of Expert Telemedicine Conversations in Bengalicited by 0