mlsanityData to 14 Oct 2026

Knowledge-aware Document Summarization: A Survey of Knowledge, Embedding Methods and Architectures

arXiv 2204.11190 ↗First posted 24 Apr 2022cs.CL cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Knowledge-aware methods have boosted a range of natural language processing applications over the last decades. With the gathered momentum, knowledge recently has been pumped into enormous attention in document summarization, one of natural language processing applications. Previous works reported that knowledge-embedded document summarizers excel at generating superior digests, especially in terms of informativeness, coherence, and fact consistency. This paper pursues to present the first systematic survey for the state-of-the-art methodologies that embed knowledge into document summarizers. Particularly, we propose novel taxonomies to recapitulate knowledge and knowledge embeddings under the document summarization view. We further explore how embeddings are generated in embedding learning architectures of document summarization models, especially of deep learning models. At last, we discuss the challenges of this topic and future directions.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 65 references that are in the map. First posted on arXiv 24 Apr 2022.

Builds on

35 of 65 references.

References · 35

  1. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  2. 2015Teaching Machines to Read and Comprehendcited by 1,049
  3. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  4. 2020Knowledge Graphscited by 621
  5. 2019Text Summarization with Pretrained Encoderscited by 556
  6. 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
  7. 2017A Comprehensive Survey of Graph Embedding: Problems, Techniques and Applicationscited by 260
  8. 2019Text Generation from Knowledge Graphs with Graph Transformerscited by 122
  9. 2019HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarizationcited by 121
  10. 2020SciREX: A Challenge Dataset for Document-Level Information Extractioncited by 113
  11. 2020KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoningcited by 106
  12. 2019Discourse-Aware Neural Extractive Text Summarizationcited by 105
23 more
  1. 2020Heterogeneous Graph Neural Networks for Extractive Document Summarizationcited by 91
  2. 2017Discovering Discrete Latent Topics with Neural Variational Inferencecited by 79
  3. 2020Leveraging Graph to Improve Abstractive Multi-Document Summarizationcited by 67
  4. 2020Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Rewardcited by 66
  5. 2018Story Ending Generation with Incremental Encoding and Commonsense Knowledgecited by 60
  6. 2020Multi-document Summarization via Deep Learning Techniques: A Surveycited by 58
  7. 2020Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graphcited by 57
  8. 2017Graph-based Neural Multi-Document Summarizationcited by 54
  9. 2020Understanding graph embedding methods and their applicationscited by 51
  10. 2018Toward Abstractive Summarization Using Semantic Representationscited by 43
  11. 2019Pretraining-Based Natural Language Generation for Text Summarizationcited by 40
  12. 2019Using Local Knowledge Graph Construction to Scale Seq2Seq Models to Multi-Document Inputscited by 38
  13. 2021Factual Consistency Evaluation for Text Summarization via Counterfactual Estimationcited by 37
  14. 2019An Entity-Driven Framework for Abstractive Summarizationcited by 25
  15. 2020Enhancing Extractive Text Summarization with Topic-Aware Graph Neural Networkscited by 22
  16. 2021BASS: Boosting Abstractive Summarization with Unified Semantic Graphcited by 21
  17. 2020From Standard Summarization to New Tasks and Beyond: Summarization with Manifold Informationcited by 16
  18. 2020Mind The Facts: Knowledge-Boosted Coherent Abstractive Text Summarizationcited by 13
  19. 2021Learning Embeddings from Knowledge Graphs With Numeric Edge Attributescited by 10
  20. 2021SgSum: Transforming Multi-document Summarization into Sub-graph Selectioncited by 8
  21. 2020Extracting Summary Knowledge Graphs from Long Documentscited by 6
  22. 2020Fact-level Extractive Summarization with Hierarchical Graph Mask on BERTcited by 4
  23. 2018Semantic Sentence Embeddings for Paraphrasing and Text Summarizationcited by 3

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 1.

2 papers.