SumREN: Summarizing Reported Speech about Events in News
Not on the map. Why?
Abstract (arXiv)
A primary objective of news articles is to establish the factual record for an event, frequently achieved by conveying both the details of the specified event (i.e., the 5 Ws; Who, What, Where, When and Why regarding the event) and how people reacted to it (i.e., reported statements). However, existing work on news summarization almost exclusively focuses on the event details. In this work, we propose the novel task of summarizing the reactions of different speakers, as expressed by their reported statements, to a given event. To this end, we create a new multi-document summarization benchmark, SUMREN, comprising 745 summaries of reported statements from various public figures obtained from 633 news articles discussing 132 events. We propose an automatic silver training data generation approach for our task, which helps smaller models like BART achieve GPT-3 level performance on this task. Finally, we introduce a pipeline-based framework for summarizing reported speech, which we empirically show to generate summaries that are more abstractive and factual than baseline query-focused summarization approaches.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 30 of its 54 references that are in the map. First posted on arXiv 2 Dec 2022.
Builds on
30 of 54 references.
References · 30
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2015Teaching Machines to Read and Comprehendcited by 1,049
- 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 689
- 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
- 2019Multi-News: a Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical Modelcited by 431
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 365
18 more
- 2018Generating Wikipedia by Summarizing Long Sequencescited by 335
- 2022News Summarization and Evaluation in the Era of GPT-3cited by 327
- 2018Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategiescited by 294
- 2021Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metricscited by 287
- 2021Generating Datasets with Pretrained Language Modelscited by 193
- 2021Entity-level Factual Consistency of Abstractive Text Summarizationcited by 118
- 2022ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linkingcited by 74
- 2021Exploring Neural Models for Query-Focused Summarizationcited by 44
- 2020AQuaMuSe: Automatically Generating Datasets for Query-Based Multi-Document Summarizationcited by 42
- 2020Generating Representative Headlines for News Storiescited by 39
- 2019Earlier Isn't Always Better: Sub-aspect Analysis on Corpus and System Biases in Summarizationcited by 28
- 2020Generating Query Focused Summaries from Query-Free Resourcescited by 27
- 2020Summary-Source Proposition-level Alignment: Task, Datasets and Supervised Baselinecited by 22
- 2013Sentiment Analysis in the Newscited by 20
- 2021Controllable Summarization with Constrained Markov Decision Processcited by 17
- 2021Proposition-Level Clustering for Multi-Document Summarizationcited by 14
- 2021DirectQuote: A Dataset for Direct Quotation Extraction and Attribution in News Articlescited by 10
- 2021End-to-end Neural Coreference Resolution Revisited: A Simple yet Effective Baselinecited by 7
Built on by
Citing papers per year: 2023: 4.
4 papers.
- 2023SmartBook: AI-Assisted Situation Report Generation for Intelligence Analystscited by 9
- 2023Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarizationcited by 9
- 2023Interpretable Automatic Fine-grained Inconsistency Detection in Text Summarizationcited by 6
- 2023FRACAS: A FRench Annotated Corpus of Attribution relations in newScited by 3
- 2023FRACAS: A FRench Annotated Corpus of Attribution relations in newS19 Sep 2023
- 2023Interpretable Automatic Fine-grained Inconsistency Detection in Text Summarization23 May 2023
- 2023Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarization3 May 2023
- 2023SmartBook: AI-Assisted Situation Report Generation for Intelligence Analysts25 Mar 2023