mlsanityData to 7 Oct 2026

A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents

arXiv 1804.05685 ↗First posted 16 Apr 2018cs.CLcited by 477

Not on the map. Why?

Cited by 28 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Neural abstractive summarization models have led to promising results in summarizing relatively short documents. We propose the first model for abstractive summarization of single, longer-form documents (e.g., research papers). Our approach consists of a new hierarchical encoder that models the discourse structure of a document, and an attentive discourse-aware decoder to generate the summary. Empirical results on two large-scale datasets of scientific papers show that our model significantly outperforms state-of-the-art models.

Key facts. Cited by 477 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 70; 2022: 83; 2023: 91; 2024: 79; 2025: 79; 2026: 75.

477 papers.

Sort:

By area:

  1. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
  2. 2024Simple and Effective Masked Diffusion Language Modelscited by 800
  3. 2024Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Servecited by 507
  4. 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 385
  5. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
  6. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
  7. 2021Efficient Attentions for Long Document Summarizationcited by 342
  8. 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
  9. 2021Recursively Summarizing Books with Human Feedbackcited by 287
  10. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  11. 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
  12. 2023LooGLE: Can Long-Context Language Models Understand Long Contexts?cited by 200
38 more
  1. 2024Mooncake: A KVCache-centric Disaggregated Architecture for LLM Servingcited by 193
  2. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
  3. 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
  4. 2022SCROLLS: Standardized CompaRison Over Long Language Sequencescited by 170
  5. 2023Unified Demonstration Retriever for In-Context Learningcited by 141
  6. 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
  7. 2023Unlimiformer: Long-Range Transformers with Unlimited Length Inputcited by 127
  8. 2023Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Healthcited by 118
  9. 2023ACI-BENCH: a Novel Ambient Clinical Intelligence Dataset for Benchmarking Automatic Visit Note Generationcited by 116
  10. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
  11. 2023LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarizationcited by 96
  12. 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
  13. 2021Sparse is Enough in Scaling Transformerscited by 86
  14. 2024Energy-Based Diffusion Language Models for Text Generationcited by 86
  15. 2023CoLT5: Faster Long-Range Transformers with Conditional Computationcited by 84
  16. 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
  17. 2023Benchmarking large language models for biomedical natural language processing applications and recommendationscited by 78
  18. 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
  19. 2023On the Learnability of Watermarks for Language Modelscited by 72
  20. 2023Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Surveycited by 71
  21. 2023RewriteLM: An Instruction-Tuned Large Language Model for Text Rewritingcited by 67
  22. 2021Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documentscited by 64
  23. 2021Can We Automate Scientific Reviewing?cited by 63
  24. 2021PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarizationcited by 62
  25. 2021Fastformer: Additive Attention Can Be All You Needcited by 61
  26. 2022SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarizationcited by 61
  27. 2021Poolingformer: Long Document Modeling with Pooling Attentioncited by 60
  28. 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
  29. 2023Extractive Summarization via ChatGPT for Faithful Summary Generationcited by 58
  30. 2023SeqXGPT: Sentence-Level AI-Generated Text Detectioncited by 55
  31. 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 54
  32. 2023BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language Modelscited by 53
  33. 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
  34. 2021A Survey on Dialogue Summarization: Recent Advances and New Frontierscited by 51
  35. 2021Attention, please! A survey of Neural Attention Models in Deep Learningcited by 50
  36. 2022SQuALITY: Building a Long-Document Summarization Dataset the Hard Waycited by 50
  37. 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
  38. 2023A Survey on Long Text Modeling with Transformerscited by 47

50 most cited of 477 All 477 (JSON)