mlsanityData to 7 Oct 2026

Improving Biomedical Abstractive Summarisation with Knowledge Aggregation from Citation Papers

arXiv 2310.15684 ↗First posted 24 Oct 2023cs.CL cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Abstracts derived from biomedical literature possess distinct domain-specific characteristics, including specialised writing styles and biomedical terminologies, which necessitate a deep understanding of the related literature. As a result, existing language models struggle to generate technical summaries that are on par with those produced by biomedical experts, given the absence of domain-specific background knowledge. This paper aims to enhance the performance of language models in biomedical abstractive summarisation by aggregating knowledge from external papers cited within the source article. We propose a novel attention-based citation aggregation model that integrates domain-specific knowledge from citation papers, allowing neural networks to generate summaries by leveraging both the paper content and relevant knowledge from citation papers. Furthermore, we construct and release a large-scale biomedical summarisation dataset that serves as a foundation for our research. Extensive experiments demonstrate that our model outperforms state-of-the-art approaches and achieves substantial improvements in abstractive biomedical text summarisation.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 26 of its 49 references that are in the map. First posted on arXiv 24 Oct 2023.

Builds on

26 of 49 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  5. 2020Longformer: The Long-Document Transformercited by 3,362
  6. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  7. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  8. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  9. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
  10. 2022BioBART: Pretraining and Evaluation of A Biomedical Generative Language Modelcited by 83
  11. 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
  12. 2019ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networkscited by 73
14 more
  1. 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 54
  2. 2021D2S: Document-to-Slide Generation Via Query-Based Text Summarizationcited by 48
  3. 2020Attend to Medical Ontologies: Content Selection for Clinical Abstractive Summarizationcited by 26
  4. 2023Effective Distillation of Table-based Reasoning Ability from LLMscited by 23
  5. 2022EtriCA: Event-Triggered Context-Aware Story Generation Augmented by Cross Attentioncited by 17
  6. 2023TwistList: Resources and Baselines for Tongue Twister Generationcited by 16
  7. 2023Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregationcited by 16
  8. 2021Enhancing Scientific Papers Summarization with Citation Graphcited by 14
  9. 2022Recent Advances in Neural Text Generation: A Task-Agnostic Surveycited by 14
  10. 2022NGEP: A Graph-based Event Planning Framework for Story Generationcited by 13
  11. 2022Improving Chinese Story Generation via Awareness of Syntactic Dependencies and Semanticscited by 10
  12. 2023Improving Medical Dialogue Generation with Abstract Meaning Representationscited by 10
  13. 2023CADGE: Context-Aware Dialogue Generation Enhanced with Graph-Structured Knowledge Aggregationcited by 8
  14. 2023Overview of the BioLaySumm 2023 Shared Task on Lay Summarization of Biomedical Research Articlescited by 6

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 3; 2025: 3.

9 papers.