mlsanityData to 7 Oct 2026

On Extractive and Abstractive Neural Document Summarization with Transformer Language Models

arXiv 1909.03186 ↗First posted 7 Sep 2019cs.CLcited by 83

Not on the map. Why?

Abstract (arXiv)

We present a method to produce abstractive summaries of long documents that exceed several thousand words via neural abstractive summarization. We perform a simple extractive step before generating a summary, which is then used to condition the transformer language model on relevant information before being tasked with generating a summary. We show that this extractive step significantly improves summarization results. We also show that this approach produces more abstractive summaries compared to prior work that employs a copy mechanism while still achieving higher rouge scores. Note: The abstract above was not written by the authors, it was generated by one of the models presented in this paper.

Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 24; 2022: 18; 2023: 17; 2024: 12; 2025: 10; 2026: 2.

83 papers.

Sort:

By area:

  1. 2021Efficient Attentions for Long Document Summarizationcited by 342
  2. 2021Recursively Summarizing Books with Human Feedbackcited by 287
  3. 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 181
  4. 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 154
  5. 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
  6. 2023Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Supportcited by 75
  7. 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
  8. 2021Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documentscited by 64
  9. 2021Can We Automate Scientific Reviewing?cited by 63
  10. 2021Poolingformer: Long Document Modeling with Pooling Attentioncited by 60
  11. 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
  12. 2023A Survey on Long Text Modeling with Transformerscited by 47
38 more
  1. 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decodercited by 44
  2. 2022Long Document Summarization with Top-down and Bottom-up Inferencecited by 42
  3. 2022Submodularity In Machine Learning and Artificial Intelligencecited by 37
  4. 2021Bringing Structure into Summaries: a Faceted Summarization Dataset for Long Scientific Documentscited by 33
  5. 2022HEGEL: Hypergraph Transformer for Long Document Summarizationcited by 28
  6. 2022Toward Unifying Text Segmentation and Long Document Summarizationcited by 28
  7. 2022HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Informationcited by 26
  8. 2022How Far are We from Robust Long Abstractive Summarization?cited by 25
  9. 2021Long Document Summarization in a Low Resource Setting using Pretrained Language Modelscited by 24
  10. 2021Long-Span Summarization via Local Attention and Content Selectioncited by 24
  11. 2022OASum: Large-Scale Open Domain Aspect-based Summarizationcited by 24
  12. 2021Topic-Aware Contrastive Learning for Abstractive Dialogue Summarizationcited by 23
  13. 2021BASS: Boosting Abstractive Summarization with Unified Semantic Graphcited by 21
  14. 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
  15. 2021Enriching and Controlling Global Semantics for Text Summarizationcited by 20
  16. 2024ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publicationscited by 20
  17. 2021MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processescited by 19
  18. 2021Word Graph Guided Summarization for Radiology Findingscited by 19
  19. 2024LLMCO2: Advancing Accurate Carbon Footprint Prediction for LLM Inferencescited by 19
  20. 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 15
  21. 2022Salience Allocation as Guidance for Abstractive Summarizationcited by 14
  22. 2022Improving Multi-Document Summarization through Referenced Flexible Extraction with Credit-Awarenesscited by 13
  23. 2024VisionGPT: LLM-Assisted Real-Time Anomaly Detection for Safe Visual Navigationcited by 13
  24. 2024LitLLMs, LLMs for Literature Review: Are we there yet?cited by 12
  25. 2023Linear Log-Normal Attention with Unbiased Concentrationcited by 11
  26. 2021Nowcasting-Nets: Deep Neural Network Structures for Precipitation Nowcasting Using IMERGcited by 10
  27. 2022Leveraging Locality in Abstractive Text Summarizationcited by 9
  28. 2022GoSum: Extractive Summarization of Long Documents by Reinforcement Learning and Graph Organized discourse statecited by 9
  29. 2023Generating EDU Extracts for Plan-Guided Summary Re-Rankingcited by 9
  30. 2023Contrastive Hierarchical Discourse Graph for Scientific Document Summarizationcited by 9
  31. 2025Agent-as-Judge for Factual Summarization of Long Narrativescited by 9
  32. 2022Towards Abstractive Grounded Summarization of Podcast Transcriptscited by 8
  33. 2023Cross-lingual Cross-temporal Summarization: Dataset, Models, Evaluationcited by 8
  34. 2025HELIOS: Adaptive Model And Early-Exit Selection for Efficient LLM Inference Servingcited by 8
  35. 2023Concise Answers to Complex Questions: Summarization of Long-form Answerscited by 7
  36. 2021Summarization, Simplification, and Generation: The Case of Patentscited by 6
  37. 2025An Evaluation of Large Language Models on Text Summarization Tasks Using Prompt Engineering Techniquescited by 6
  38. 2022Scientific Paper Extractive Summarization Enhanced by Citation Graphscited by 5

50 most cited of 83 All 83 (JSON)