mlsanityData to 7 Oct 2026

Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategies

arXiv 1804.11283 ↗First posted 30 Apr 2018cs.CLcited by 292

Not on the map. Why?

Abstract (arXiv)

We present NEWSROOM, a summarization dataset of 1.3 million articles and summaries written by authors and editors in newsrooms of 38 major news publications. Extracted from search and social media metadata between 1998 and 2017, these high-quality summaries demonstrate high diversity of summarization styles. In particular, the summaries combine abstractive and extractive strategies, borrowing words and phrases from articles at varying rates. We analyze the extraction strategies used in NEWSROOM summaries against other datasets to quantify the diversity and difficulty of our new data, and train existing methods on the data to evaluate its utility and challenges.

Key facts. Cited by 292 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 61; 2022: 59; 2023: 62; 2024: 57; 2025: 30; 2026: 23.

292 papers.

Sort:

By area:

  1. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  2. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  3. 2023Benchmarking Large Language Models for News Summarizationcited by 444
  4. 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 420
  5. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
  6. 2023GPTScore: Evaluate as You Desirecited by 357
  7. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 346
  8. 2021Efficient Attentions for Long Document Summarizationcited by 342
  9. 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
  10. 2024LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Taskscited by 236
  11. 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
  12. 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 193
38 more
  1. 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
  2. 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
  3. 2024Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluatorscited by 146
  4. 2022Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluationcited by 141
  5. 2023Human-like Summarization Evaluation with ChatGPTcited by 126
  6. 2023Exploring the Limits of ChatGPT for Query or Aspect-based Text Summarizationcited by 122
  7. 2021Entity-level Factual Consistency of Abstractive Text Summarizationcited by 118
  8. 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 108
  9. 2021Robustness Gym: Unifying the NLP Evaluation Landscapecited by 107
  10. 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
  11. 2021Time Waits for No One! Analysis and Challenges of Temporal Misalignmentcited by 91
  12. 2022Evaluating Human-Language Model Interactioncited by 90
  13. 2023TrueTeacher: Learning Factual Consistency Evaluation with Large Language Modelscited by 82
  14. 2023MeetingBank: A Benchmark Dataset for Meeting Summarizationcited by 81
  15. 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
  16. 2023Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Methodcited by 76
  17. 2021Evaluating Attribution in Dialogue Systems: The BEGIN Benchmarkcited by 75
  18. 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
  19. 2022Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generationcited by 73
  20. 2023GPTEval: A Survey on Assessments of ChatGPT and GPT-4cited by 73
  21. 2023Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedbackcited by 71
  22. 2021Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasurescited by 69
  23. 2022ECTSum: A New Benchmark Dataset For Bullet Point Summarization of Long Earnings Call Transcriptscited by 59
  24. 2023HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attributioncited by 55
  25. 2023Calibrating LLM-Based Evaluatorcited by 53
  26. 2023From Sparse to Dense: GPT-4 Summarization with Chain of Density Promptingcited by 52
  27. 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
  28. 2021Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarizationcited by 50
  29. 2021D2S: Document-to-Slide Generation Via Query-Based Text Summarizationcited by 48
  30. 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
  31. 2023Fusing Models with Complementary Expertisecited by 45
  32. 2021MReD: A Meta-Review Dataset for Structure-Controllable Text Generationcited by 42
  33. 2021Towards Knowledge-Grounded Counter Narrative Generation for Hate Speechcited by 41
  34. 2023Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theorycited by 41
  35. 2022EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domaincited by 39
  36. 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
  37. 2022On Improving Summarization Factual Consistency from Natural Language Feedbackcited by 38
  38. 2024Leveraging Large Language Models for NLG Evaluation: Advances and Challengescited by 37

50 most cited of 292 All 292 (JSON)