mlsanityData to 14 Oct 2026

Extractive Summarization of Long Documents by Combining Global and Local Context

arXiv 1909.08089 ↗First posted 17 Sep 2019cs.CLcited by 59

Not on the map. Why?

Abstract (arXiv)

In this paper, we propose a novel neural single document extractive summarization model for long documents, incorporating both the global context of the whole document and the local context within the current topic. We evaluate the model on two datasets of scientific papers, Pubmed and arXiv, where it outperforms previous work, both extractive and abstractive models, on ROUGE-1, ROUGE-2 and METEOR scores. We also show that, consistently with our goal, the benefits of our method become stronger as we apply it to longer documents. Rather surprisingly, an ablation study indicates that the benefits of our model seem to come exclusively from modeling the local context, even for the longest documents.

Key facts. Cited by 59 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 19; 2022: 15; 2023: 12; 2024: 10; 2025: 3.

59 papers.

Sort:

By area:

  1. 2021Efficient Attentions for Long Document Summarizationcited by 345
  2. 2021Recursively Summarizing Books with Human Feedbackcited by 290
  3. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 102
  4. 2024Not All Heads Matter: A Head-Level KV Cache Compression Method with Integrated Retrieval and Reasoningcited by 97
  5. 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
  6. 2021Can We Automate Scientific Reviewing?cited by 63
  7. 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
  8. 2021DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarizationcited by 34
  9. 2021Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarizationcited by 32
  10. 2022HEGEL: Hypergraph Transformer for Long Document Summarizationcited by 28
  11. 2022Toward Unifying Text Segmentation and Long Document Summarizationcited by 28
  12. 2022HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Informationcited by 26
38 more
  1. 2022How Far are We from Robust Long Abstractive Summarization?cited by 25
  2. 2021Long-Span Summarization via Local Attention and Content Selectioncited by 24
  3. 2021Incorporating Domain Knowledge for Extractive Summarization of Legal Case Documentscited by 23
  4. 2022HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarizationcited by 23
  5. 2021MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processescited by 19
  6. 2021Hierarchical Cross-Modality Semantic Correlation Learning Model for Multimodal Summarizationcited by 18
  7. 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
  8. 2024Characterizing Prompt Compression Methods for Long Context Inferencecited by 18
  9. 2021StreamHover: Livestream Transcript Summarization and Annotationcited by 15
  10. 2023Improving Long Document Topic Segmentation Models With Enhanced Coherence Modelingcited by 15
  11. 2021Enhancing Scientific Papers Summarization with Citation Graphcited by 14
  12. 2021Leveraging Information Bottleneck for Scientific Document Summarizationcited by 13
  13. 2022Entity-based SpanCopy for Abstractive Summarization to Improve the Factual Consistencycited by 11
  14. 2021Predicting Discourse Trees from Transformer-based Neural Summarizerscited by 10
  15. 2021Demoting the Lead Bias in News Summarization via Alternating Adversarial Learningcited by 10
  16. 2021Iterative Hierarchical Attention for Answering Complex Questions over Long Documentscited by 10
  17. 2023Exploiting Pseudo Image Captions for Multimodal Summarizationcited by 10
  18. 2022Leveraging Locality in Abstractive Text Summarizationcited by 9
  19. 2022GoSum: Extractive Summarization of Long Documents by Reinforcement Learning and Graph Organized discourse statecited by 9
  20. 2023Contrastive Hierarchical Discourse Graph for Scientific Document Summarizationcited by 9
  21. 2021Extractive Research Slide Generation Using Windowed Labeling Rankingcited by 7
  22. 2023Neural Natural Language Processing for Long Texts: A Survey on Classification and Summarizationcited by 7
  23. 2024SlideSpawn: An Automatic Slides Generation System for Research Publicationscited by 6
  24. 2021Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequencescited by 5
  25. 2022Improving Topic Segmentation by Injecting Discourse Dependenciescited by 5
  26. 2022Scientific Paper Extractive Summarization Enhanced by Citation Graphscited by 5
  27. 2023SciLit: A Platform for Joint Scientific Literature Discovery, Summarization and Citation Generationcited by 5
  28. 2023BUS:Efficient and Effective Vision-language Pre-training with Bottom-Up Patch Summarizationcited by 5
  29. 2024Multi-LLM Text Summarizationcited by 5
  30. 2021Summaformers @ LaySumm 20, LongSumm 20cited by 4
  31. 2022TSTR: Too Short to Represent, Summarize with Details! Intro-Guided Extended Summary Generationcited by 4
  32. 2024Hierarchical Attention Graph for Scientific Document Summarization in Global and Local Levelcited by 4
  33. 2024Scaling Up Summarization: Leveraging Large Language Models for Long Text Extractive Summarizationcited by 4
  34. 2024GraphLSS: Integrating Lexical, Structural, and Semantic Features for Long Document Extractive Summarizationcited by 4
  35. 2022Taxonomy of Abstractive Dialogue Summarization: Scenarios, Approaches and Future Directionscited by 3
  36. 2023Advancing Topic Segmentation and Outline Generation in Chinese Texts: The Paragraph-level Topic Representation, Corpus, and Benchmarkcited by 3
  37. 2023Surveying the Landscape of Text Summarization with Deep Learning: A Comprehensive Reviewcited by 2
  38. 2025CrossFormer: Cross-Segment Semantic Fusion for Document Segmentationcited by 2

50 most cited of 59 All 59 (JSON)