mlsanityData to 7 Oct 2026

BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarization

arXiv 1906.03741 ↗First posted 10 Jun 2019cs.CL cs.LGcited by 155

Not on the map. Why?

Abstract (arXiv)

Most existing text summarization datasets are compiled from the news domain, where summaries have a flattened discourse structure. In such datasets, summary-worthy content often appears in the beginning of input articles. Moreover, large segments from input articles are present verbatim in their respective summaries. These issues impede the learning and evaluation of systems that can understand an article's global content structure as well as produce abstractive summaries with high compression ratio. In this work, we present a novel dataset, BIGPATENT, consisting of 1.3 million records of U.S. patent documents along with human written abstractive summaries. Compared to existing summarization datasets, BIGPATENT has the following properties: i) summaries contain a richer discourse structure with more recurring entities, ii) salient content is evenly distributed in the input, and iii) lesser and shorter extractive fragments are present in the summaries. Finally, we train and evaluate baselines and popular learning models on BIGPATENT to shed light on new challenges and motivate future directions for summarization research.

Key facts. Cited by 155 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jun 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 24; 2022: 26; 2023: 27; 2024: 41; 2025: 20; 2026: 17.

155 papers.

Sort:

By area:

  1. 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
  2. 2021Efficient Attentions for Long Document Summarizationcited by 342
  3. 2021Recursively Summarizing Books with Human Feedbackcited by 287
  4. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 255
  5. 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
  6. 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
  7. 2023L-Eval: Instituting Standardized Evaluation for Long Context Language Modelscited by 232
  8. 2023LooGLE: Can Long-Context Language Models Understand Long Contexts?cited by 200
  9. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
  10. 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
  11. 2024A Survey on Large Language Model Acceleration based on KV Cache Managementcited by 125
  12. 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
38 more
  1. 2023Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documentscited by 103
  2. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
  3. 2024Stable LM 2 1.6B Technical Reportcited by 86
  4. 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
  5. 2023Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decodingcited by 80
  6. 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
  7. 2021Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasurescited by 69
  8. 2023RewriteLM: An Instruction-Tuned Large Language Model for Text Rewritingcited by 67
  9. 2024MAP-Neo: Highly Capable and Transparent Bilingual Large Language Model Seriescited by 67
  10. 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
  11. 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 54
  12. 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
  13. 2022SQuALITY: Building a Long-Document Summarization Dataset the Hard Waycited by 50
  14. 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
  15. 2021Exploring Neural Models for Query-Focused Summarizationcited by 44
  16. 2024ExeGPT: Constraint-Aware Resource Scheduling for LLM Inferencecited by 43
  17. 2021MReD: A Meta-Review Dataset for Structure-Controllable Text Generationcited by 42
  18. 2025Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMscited by 40
  19. 2022A Survey on Cross-Lingual Summarizationcited by 38
  20. 2024M-RAG: Reinforcing Large Language Model Performance through Retrieval-Augmented Generation with Multiple Partitionscited by 38
  21. 2021What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarizationcited by 35
  22. 2021DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarizationcited by 34
  23. 2021Bringing Structure into Summaries: a Faceted Summarization Dataset for Long Scientific Documentscited by 33
  24. 2024Towards Optimizing the Costs of LLM Usagecited by 33
  25. 2022The Harvard USPTO Patent Dataset: A Large-Scale, Well-Structured, and Multi-Purpose Corpus of Patent Applicationscited by 32
  26. 2022Submix: Practical Private Prediction for Large-Scale Language Modelscited by 31
  27. 2021Does Pretraining for Summarization Require Knowledge Transfer?cited by 30
  28. 2021An Exploratory Study on Long Dialogue Summarization: What Works and What's Nextcited by 28
  29. 2024Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLPcited by 27
  30. 2022How Far are We from Robust Long Abstractive Summarization?cited by 25
  31. 2022Don't Say What You Don't Know: Improving the Consistency of Abstractive Summarization by Constraining Beam Searchcited by 23
  32. 2022Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluationcited by 23
  33. 2026Hidden in Memory: Sleeper Memory Poisoning in LLM Agentscited by 22
  34. 2021BASS: Boosting Abstractive Summarization with Unified Semantic Graphcited by 21
  35. 2023Interpretable-by-Design Text Understanding with Iteratively Generated Concept Bottleneckcited by 21
  36. 2024Adaptive Memory Replay for Continual Learningcited by 21
  37. 2024Natural Language Processing in the Patent Domain: A Surveycited by 20
  38. 2021TODSum: Task-Oriented Dialogue Summarization with State Trackingcited by 19

50 most cited of 155 All 155 (JSON)