Improving Biomedical Abstractive Summarisation with Knowledge Aggregation from Citation Papers
Not on the map. Why?
Abstract (arXiv)
Abstracts derived from biomedical literature possess distinct domain-specific characteristics, including specialised writing styles and biomedical terminologies, which necessitate a deep understanding of the related literature. As a result, existing language models struggle to generate technical summaries that are on par with those produced by biomedical experts, given the absence of domain-specific background knowledge. This paper aims to enhance the performance of language models in biomedical abstractive summarisation by aggregating knowledge from external papers cited within the source article. We propose a novel attention-based citation aggregation model that integrates domain-specific knowledge from citation papers, allowing neural networks to generate summaries by leveraging both the paper content and relevant knowledge from citation papers. Furthermore, we construct and release a large-scale biomedical summarisation dataset that serves as a foundation for our research. Extensive experiments demonstrate that our model outperforms state-of-the-art approaches and achieves substantial improvements in abstractive biomedical text summarisation.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 26 of its 49 references that are in the map. First posted on arXiv 24 Oct 2023.
Builds on
26 of 49 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
- 2022BioBART: Pretraining and Evaluation of A Biomedical Generative Language Modelcited by 83
- 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
- 2019ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networkscited by 73
14 more
- 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 54
- 2021D2S: Document-to-Slide Generation Via Query-Based Text Summarizationcited by 48
- 2020Attend to Medical Ontologies: Content Selection for Clinical Abstractive Summarizationcited by 26
- 2023Effective Distillation of Table-based Reasoning Ability from LLMscited by 23
- 2022EtriCA: Event-Triggered Context-Aware Story Generation Augmented by Cross Attentioncited by 17
- 2023TwistList: Resources and Baselines for Tongue Twister Generationcited by 16
- 2023Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregationcited by 16
- 2021Enhancing Scientific Papers Summarization with Citation Graphcited by 14
- 2022Recent Advances in Neural Text Generation: A Task-Agnostic Surveycited by 14
- 2022NGEP: A Graph-based Event Planning Framework for Story Generationcited by 13
- 2022Improving Chinese Story Generation via Awareness of Syntactic Dependencies and Semanticscited by 10
- 2023Improving Medical Dialogue Generation with Abstract Meaning Representationscited by 10
- 2023CADGE: Context-Aware Dialogue Generation Enhanced with Graph-Structured Knowledge Aggregationcited by 8
- 2023Overview of the BioLaySumm 2023 Shared Task on Lay Summarization of Biomedical Research Articlescited by 6
Built on by
Citing papers per year: 2023: 3; 2024: 3; 2025: 3.
9 papers.
- 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
- 2025SurveyX: Academic Survey Automation via Large Language Modelscited by 27
- 2024SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluationcited by 11
- 2024RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarizationcited by 10
- 2023A Cross-Attention Augmented Model for Event-Triggered Context-Aware Story Generationcited by 5
- 2025Explanatory Summarization with Discourse-Driven Planningcited by 4
- 2025Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasingcited by 3
- 2023ACL Anthology Helper: A Tool to Retrieve and Manage Literature from ACL Anthologycited by 0
- 2024BioMNER: A Dataset for Biomedical Method Entity Recognitioncited by 0
- 2025Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing24 May 2025
- 2025Explanatory Summarization with Discourse-Driven Planning27 Apr 2025
- 2025SurveyX: Academic Survey Automation via Large Language Models20 Feb 2025
- 2024BioMNER: A Dataset for Biomedical Method Entity Recognition28 Jun 2024
- 2024SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation24 May 2024
- 2024RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization1 May 2024
- 2023A Cross-Attention Augmented Model for Event-Triggered Context-Aware Story Generation19 Nov 2023
- 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challenge9 Nov 2023
- 2023ACL Anthology Helper: A Tool to Retrieve and Manage Literature from ACL Anthology31 Oct 2023