mlsanityData to 7 Oct 2026

BookSum: A Collection of Datasets for Long-form Narrative Summarization

arXiv 2105.08209 ↗First posted 18 May 2021cs.CLcited by 184

Not on the map. Why?

Cited by 20 in Efficient LLM inference and serving, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The majority of available text summarization datasets include short-form source documents that lack long-range causal and temporal dependencies, and often contain strong layout and stylistic biases. While relevant, such datasets will offer limited challenges for future generations of text summarization systems. We address these issues by introducing BookSum, a collection of datasets for long-form narrative summarization. Our dataset covers source documents from the literature domain, such as novels, plays and stories, and includes highly abstractive, human written summaries on three levels of granularity of increasing difficulty: paragraph-, chapter-, and book-level. The domain and structure of our dataset poses a unique set of challenges for summarization systems, which include: processing very long documents, non-trivial causal and temporal dependencies, and rich discourse structures. To facilitate future work, we trained and evaluated multiple extractive and abstractive summarization models as baselines for our dataset.

Key facts. Cited by 184 papers in the map (data through 7 Oct 2026). Builds on 29 of its 44 references that are in the map. First posted on arXiv 18 May 2021.

Builds on

29 of 44 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  6. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  7. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  8. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  9. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
  10. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  11. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  12. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
17 more
  1. 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
  2. 2019Text Summarization with Pretrained Encoderscited by 553
  3. 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 530
  4. 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
  5. 2017A Deep Reinforced Model for Abstractive Summarizationcited by 364
  6. 2018Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategiescited by 292
  7. 2019Neural Text Summarization: A Critical Evaluationcited by 189
  8. 2020Extractive Summarization as Text Matchingcited by 189
  9. 2020CORD-19: The COVID-19 Open Research Datasetcited by 179
  10. 2018Fast Abstractive Summarization with Reinforce-Selected Sentence Rewritingcited by 158
  11. 2019BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarizationcited by 155
  12. 2019Answers Unite! Unsupervised Metrics for Reinforced Summarization Modelscited by 92
  13. 2018Content Selection in Deep Learning Models of Summarizationcited by 64
  14. 2020Exploring Content Selection in Summarization of Novel Chapterscited by 29
  15. 2015A Hierarchical Neural Autoencoder for Paragraphs and Documentscited by 26
  16. 2020What's New? Summarizing Contributions in Scientific Literaturecited by 9
  17. 2018Dial2Desc: End-to-end Dialogue Description Generationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 25; 2023: 24; 2024: 49; 2025: 53; 2026: 29.

184 papers.

Sort:

By area:

  1. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
  2. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 372
  3. 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
  4. 2021Recursively Summarizing Books with Human Feedbackcited by 287
  5. 2024DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Headscited by 283
  6. 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
  7. 2023L-Eval: Instituting Standardized Evaluation for Long Context Language Modelscited by 232
  8. 2024Chain of Agents: Large Language Models Collaborating on Long-Context Taskscited by 201
  9. 2024Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentioncited by 194
  10. 2023ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understandingcited by 175
  11. 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
  12. 2023Unlimiformer: Long-Range Transformers with Unlimited Length Inputcited by 127
38 more
  1. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
  2. 2023LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarizationcited by 96
  3. 2024Long-Context Language Modeling with Parallel Context Encodingcited by 84
  4. 2022Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehensioncited by 79
  5. 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
  6. 2024Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encodingcited by 72
  7. 2021Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documentscited by 64
  8. 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
  9. 2022SQuALITY: Building a Long-Document Summarization Dataset the Hard Waycited by 50
  10. 2025Mem-α: Learning Memory Construction via Reinforcement Learningcited by 49
  11. 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
  12. 2024k-SemStamp: A Clustering-Based Semantic Watermark for Detection of Machine-Generated Textcited by 46
  13. 2021Exploring Neural Models for Query-Focused Summarizationcited by 44
  14. 2022Conditional Generation with a Question-Answering Blueprintcited by 44
  15. 2022Investigating Efficiently Extending Transformers for Long Input Summarizationcited by 43
  16. 2022Long Document Summarization with Top-down and Bottom-up Inferencecited by 42
  17. 2024Evaluating Copyright Takedown Methods for Language Modelscited by 42
  18. 2024Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarkscited by 32
  19. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Userscited by 32
  20. 2024FENICE: Factuality Evaluation of summarization based on Natural language Inference and Claim Extractioncited by 28
  21. 2024DRT: Deep Reasoning Translation via Long Chain-of-Thoughtcited by 28
  22. 2025CURIE: Evaluating LLMs On Multitask Scientific Long Context Understanding and Reasoningcited by 28
  23. 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
  24. 2022Training language models to summarize narratives improves brain alignmentcited by 26
  25. 2024A Controlled Study on Long Context Extension and Generalization in LLMscited by 26
  26. 2024Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Passcited by 26
  27. 2022OASum: Large-Scale Open Domain Aspect-based Summarizationcited by 24
  28. 2023Long Text and Multi-Table Summarization: Dataset and Methodcited by 23
  29. 2022HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarizationcited by 22
  30. 2022Adapting Pretrained Text-to-Text Models for Long Text Sequencescited by 21
  31. 2023Improving Pacing in Long-Form Story Planningcited by 21
  32. 2024Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuningcited by 21
  33. 2025DAST: Context-Aware Compression in LLMs via Dynamic Allocation of Soft Tokenscited by 21
  34. 2023Personality Understanding of Fictional Characters during Book Readingcited by 20
  35. 2022SNaC: Coherence Error Detection for Narrative Summarizationcited by 19
  36. 2024Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writerscited by 19
  37. 2024Revisiting the Robustness of Watermarking to Paraphrasing Attackscited by 19
  38. 2022ChapterBreak: A Challenge Dataset for Long-Range Language Modelscited by 18

50 most cited of 184 All 184 (JSON)