mlsanityData to 14 Oct 2026

Query-Guided Self-Supervised Summarization of Nursing Notes

arXiv 2407.04125 ↗First posted 4 Jul 2024cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Nursing notes, an important part of Electronic Health Records (EHRs), track a patient's health during a care episode. Summarizing key information in nursing notes can help clinicians quickly understand patients' conditions. However, existing summarization methods in the clinical setting, especially abstractive methods, have overlooked nursing notes and require reference summaries for training. We introduce QGSumm, a novel query-guided self-supervised domain adaptation approach for abstractive nursing note summarization. The method uses patient-related clinical queries for guidance, and hence does not need reference summaries for training. Through automatic experiments and manual evaluation by an expert clinician, we study our approach and other state-of-the-art Large Language Models (LLMs) for nursing note summarization. Our experiments show: 1) GPT-4 is competitive in maintaining information in the original nursing notes, 2) QGSumm can generate high-quality summaries with a good balance between recall of the original content and hallucination rate lower than other top methods. Ultimately, our work offers a new perspective on conditional text summarization, tailored to clinical applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 57 references that are in the map. First posted on arXiv 4 Jul 2024.

Builds on

36 of 57 references.

References · 36

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  5. 2023Mistral 7Bcited by 3,164
  6. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  7. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  8. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  9. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 722
  10. 2020Self-supervised Learning: Generative or Contrastivecited by 694
  11. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
  12. 2024BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domainscited by 301
24 more
  1. 2017Multitask learning and benchmarking with clinical time series datacited by 290
  2. 2022Can language models learn from explanations in context?cited by 249
  3. 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 246
  4. 2020Re-evaluating Evaluation in Text Summarizationcited by 145
  5. 2019Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reportscited by 96
  6. 2022Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencescited by 69
  7. 2020Generating SOAP Notes from Doctor-Patient Conversations Using Modular Summarization Techniquescited by 64
  8. 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
  9. 2021Exploring Neural Models for Query-Focused Summarizationcited by 44
  10. 2021Leveraging Pretrained Models for Automatic Summarization of Doctor-Patient Conversationscited by 42
  11. 2020TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoisingcited by 30
  12. 2022Summarizing Patients Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Modelscited by 30
  13. 2022Learning to Revise References for Faithful Summarizationcited by 28
  14. 2023RadAdapt: Radiology Report Summarization via Lightweight Domain Adaptation of Large Language Modelscited by 24
  15. 2020Self-Supervised and Controlled Multi-Document Opinion Summarizationcited by 23
  16. 2021Towards Clinical Encounter Summarization: Learning to Compose Discharge Summaries from Prior Notescited by 19
  17. 2022Discharge Summary Hospital Course Summarisation of In Patient Electronic Health Record Text with Clinical Concept Guided Deep Pre-Trained Transformer Modelscited by 18
  18. 2022Socratic Pretraining: Question-Driven Pretraining for Controllable Summarizationcited by 17
  19. 2021Attention-based Clinical Note Summarizationcited by 16
  20. 2022Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarizationcited by 12
  21. 2019Progress Notes Classification and Keyword Extraction using Attention-based Deep Learning Models with BERTcited by 11
  22. 2023Overview of the Problem List Summarization (ProbSum) 2023 Shared Task on Summarizing Patients' Active Diagnoses and Problems from Electronic Health Record Progress Notescited by 11
  23. 2023Attributable and Scalable Opinion Summarizationcited by 6
  24. 2022Unsupervised Multi-Granularity Summarizationcited by 5

Built on by

Not cited yet.