mlsanityData to 14 Oct 2026

Medical Question Summarization with Entity-driven Contrastive Learning

arXiv 2304.07437 ↗First posted 15 Apr 2023cs.CL cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

By summarizing longer consumer health questions into shorter and essential ones, medical question-answering systems can more accurately understand consumer intentions and retrieve suitable answers. However, medical question summarization is very challenging due to obvious distinctions in health trouble descriptions from patients and doctors. Although deep learning has been applied to successfully address the medical question summarization (MQS) task, two challenges remain: how to correctly capture question focus to model its semantic intention, and how to obtain reliable datasets to fairly evaluate performance. To address these challenges, this paper proposes a novel medical question summarization framework based on entity-driven contrastive learning (ECL). ECL employs medical entities present in frequently asked questions (FAQs) as focuses and devises an effective mechanism to generate hard negative samples. This approach compels models to focus on essential information and consequently generate more accurate question summaries. Furthermore, we have discovered that some MQS datasets, such as the iCliniq dataset with a 33% duplicate rate, have significant data leakage issues. To ensure an impartial evaluation of the related methods, this paper carefully examines leaked samples to reorganize more reasonable datasets. Extensive experiments demonstrate that our ECL method outperforms the existing methods and achieves new state-of-the-art performance, i.e., 52.85, 43.16, 41.31, 43.52 in terms of ROUGE-1 metric on MeQSum, CHQ-Summ, iCliniq, HealthCareMagic dataset, respectively. The code and datasets are available at https://github.com/yrbobo/MQS-ECL.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 30 of its 56 references that are in the map. First posted on arXiv 15 Apr 2023.

Builds on

30 of 56 references.

References · 30

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  7. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  8. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  9. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
  10. 2020A Survey on Contrastive Self-supervised Learningcited by 554
  11. 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 222
  12. 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
18 more
  1. 2019A Question-Entailment Approach to Question Answeringcited by 134
  2. 2021SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarizationcited by 132
  3. 2021CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarizationcited by 120
  4. 2021Contrastive Learning for Many-to-many Multilingual Neural Machine Translationcited by 108
  5. 2021CONTaiNER: Few-Shot Named Entity Recognition via Contrastive Learningcited by 64
  6. 2020Multi-document Summarization via Deep Learning Techniques: A Surveycited by 58
  7. 2021CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understandingcited by 50
  8. 2021Sequence Level Contrastive Learning for Text Summarizationcited by 31
  9. 2021Reinforcement Learning for Abstractive Question Summarization with Question-aware Semantic Rewardscited by 22
  10. 2022MCSE: Multimodal Contrastive Learning of Sentence Embeddingscited by 22
  11. 2022Improving Word Translation via Two-Stage Contrastive Learningcited by 18
  12. 2021Long Context Question Answering via Supervised Contrastive Learningcited by 17
  13. 2021Frequency-Aware Contrastive Learning for Neural Machine Translationcited by 11
  14. 2022CHQ-Summ: A Dataset for Consumer Healthcare Question Summarizationcited by 11
  15. 2022A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddingscited by 9
  16. 2022An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings Learningcited by 6
  17. 2019Domain-Relevant Embeddings for Medical Question Similaritycited by 5
  18. 2022Focus-Driven Contrastive Learniang for Medical Question Summarizationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 2.

5 papers.