Enhancing Scientific Papers Summarization with Citation Graph
Not on the map. Why?
Abstract (arXiv)
Previous work for text summarization in scientific domain mainly focused on the content of the input document, but seldom considering its citation network. However, scientific papers are full of uncommon domain-specific terms, making it almost impossible for the model to understand its true meaning without the help of the relevant research community. In this paper, we redefine the task of scientific papers summarization by utilizing their citation graph and propose a citation graph-based summarization model CGSum which can incorporate the information of both the source paper and its references. In addition, we construct a novel scientific papers summarization dataset Semantic Scholar Network (SSN) which contains 141K research papers in different domains and 661K citation relationships. The entire dataset constitutes a large connected citation graph. Extensive experiments show that our model can achieve competitive performance when compared with the pretrained models even with a simple architecture. The results also indicates the citation graph is crucial to better understand the content of papers and generate high-quality summaries.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 22 of its 35 references that are in the map. First posted on arXiv 7 Apr 2021.
Builds on
22 of 35 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017Graph Attention Networkscited by 8,854
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2015Teaching Machines to Read and Comprehendcited by 1,039
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
- 2019Text Summarization with Pretrained Encoderscited by 553
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
- 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 394
- 2017A Deep Reinforced Model for Abstractive Summarizationcited by 364
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
- 2019Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networkscited by 241
- 2020Extractive Summarization as Text Matchingcited by 189
10 more
- 2019Text Generation from Knowledge Graphs with Graph Transformerscited by 122
- 2020Heterogeneous Graph Neural Networks for Extractive Document Summarizationcited by 90
- 2019ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networkscited by 73
- 2020Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Rewardcited by 66
- 2019Extractive Summarization of Long Documents by Combining Global and Local Contextcited by 59
- 2018A Graph-to-Sequence Model for AMR-to-Text Generationcited by 56
- 2018Structured Neural Summarizationcited by 53
- 2019Searching for Effective Neural Extractive Summarization: What Works and What's Nextcited by 38
- 2017Scientific document summarization via citation contextualization and scientific discoursecited by 12
- 2020Enhancing Factual Consistency of Abstractive Summarizationcited by 10
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 4; 2024: 1; 2025: 0; 2026: 1.
14 papers.
Sort:
By area:
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2023mPLUG-PaperOwl: Scientific Diagram Analysis with the Multimodal Large Language Modelcited by 31
- 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generationcited by 22
- 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarizationcited by 19
- 2022Robust Knowledge Adaptation for Dynamic Graph Neural Networkscited by 9
- 2023Improving Biomedical Abstractive Summarisation with Knowledge Aggregation from Citation Paperscited by 9
- 2022COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarizationcited by 8
- 2023A Topic-aware Summarization Framework with Different Modal Side Informationcited by 6
- 2022Scientific Paper Extractive Summarization Enhanced by Citation Graphscited by 5
- 2021GraphPrompt: Graph-Based Prompt Templates for Biomedical Synonym Predictioncited by 2
- 2022Improving Graph-Based Text Representations with Character and Word Level N-gramscited by 2
2 more
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structure28 May 2026
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2023mPLUG-PaperOwl: Scientific Diagram Analysis with the Multimodal Large Language Model30 Nov 2023
- 2023Improving Biomedical Abstractive Summarisation with Knowledge Aggregation from Citation Papers24 Oct 2023
- 2023Adversarial Conversational Shaping for Intelligent Agents20 Jul 2023
- 2023A Topic-aware Summarization Framework with Different Modal Side Information19 May 2023
- 2022Scientific Paper Extractive Summarization Enhanced by Citation Graphs8 Dec 2022
- 2022Improving Graph-Based Text Representations with Character and Word Level N-grams12 Oct 2022
- 2022COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization29 Sep 2022
- 2022Robust Knowledge Adaptation for Dynamic Graph Neural Networks22 Jul 2022
- 2021GraphPrompt: Graph-Based Prompt Templates for Biomedical Synonym Prediction13 Nov 2021
- 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generation20 Oct 2021
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generationcited by 22
- 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarizationcited by 19
- 2022Robust Knowledge Adaptation for Dynamic Graph Neural Networkscited by 9
- 2023Improving Biomedical Abstractive Summarisation with Knowledge Aggregation from Citation Paperscited by 9
- 2022COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarizationcited by 8
- 2023A Topic-aware Summarization Framework with Different Modal Side Informationcited by 6
- 2022Scientific Paper Extractive Summarization Enhanced by Citation Graphscited by 5
- 2021GraphPrompt: Graph-Based Prompt Templates for Biomedical Synonym Predictioncited by 2
- 2022Improving Graph-Based Text Representations with Character and Word Level N-gramscited by 2
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structurecited by 2
12 most cited of 13 All 13 (JSON)
- 2026COMPOSE: Composing Future Theorems from Citations and Formal Structure28 May 2026
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2023Improving Biomedical Abstractive Summarisation with Knowledge Aggregation from Citation Papers24 Oct 2023
- 2023Adversarial Conversational Shaping for Intelligent Agents20 Jul 2023
- 2023A Topic-aware Summarization Framework with Different Modal Side Information19 May 2023
- 2022Scientific Paper Extractive Summarization Enhanced by Citation Graphs8 Dec 2022
- 2022Improving Graph-Based Text Representations with Character and Word Level N-grams12 Oct 2022
- 2022COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization29 Sep 2022
- 2022Robust Knowledge Adaptation for Dynamic Graph Neural Networks22 Jul 2022
- 2021GraphPrompt: Graph-Based Prompt Templates for Biomedical Synonym Prediction13 Nov 2021
- 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generation20 Oct 2021
- 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarization16 Sep 2021
12 newest of 13 All 13 (JSON)