Content Selection in Deep Learning Models of Summarization
Not on the map. Why?
Abstract (arXiv)
We carry out experiments with deep learning models of summarization across the domains of news, personal stories, meetings, and medical articles in order to understand how content selection is performed. We find that many sophisticated features of state of the art extractive summarizers do not improve performance over simpler models. These results suggest that it is easier to create a summarizer for a new domain than previous work suggests and bring into question the benefit of deep learning models for summarization for those domains that do have massive datasets (i.e., news). At the same time, they suggest important questions for new research in summarization; namely, new forms of sentence representations or external knowledge sources are needed that are better suited to the summarization task.
Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 27; 2022: 19; 2023: 7; 2024: 5; 2025: 2; 2026: 4.
64 papers.
Sort:
By area:
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 365
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
- 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
- 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 155
- 2023Unlimiformer: Long-Range Transformers with Unlimited Length Inputcited by 128
- 2021Robustness Gym: Unifying the NLP Evaluation Landscapecited by 108
- 2021MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarizationcited by 104
- 2021Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarizationcited by 51
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
- 2021Controllable Neural Dialogue Summarization with Personal Named Entity Planningcited by 36
- 2021What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarizationcited by 35
38 more
- 2021InfoLM: A New Metric to Evaluate Summarization & Data2Text Generationcited by 33
- 2022Toward Unifying Text Segmentation and Long Document Summarizationcited by 28
- 2021RefSum: Refactoring Neural Summarizationcited by 25
- 2022Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluationcited by 24
- 2021Unsupervised Extractive Summarization using Pointwise Mutual Informationcited by 23
- 2022EntSUM: A Data Set for Entity-Centric Summarizationcited by 22
- 2023A Survey on Out-of-Distribution Evaluation of Neural NLP Modelscited by 20
- 2021TODSum: Task-Oriented Dialogue Summarization with State Trackingcited by 19
- 2023A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understandingcited by 18
- 2023VCSUM: A Versatile Chinese Meeting Summarization Datasetcited by 18
- 2021A Pseudo-Metric between Probability Distributions based on Depth-Trimmed Regionscited by 17
- 2021End-to-End Segmentation-based News Summarizationcited by 16
- 2021StreamHover: Livestream Transcript Summarization and Annotationcited by 15
- 2021A Sliding-Window Approach to Automatic Creation of Meeting Minutescited by 14
- 2022A Survey on Medical Document Summarizationcited by 14
- 2021SummVis: Interactive Visual Analysis of Models, Data, and Evaluation for Text Summarizationcited by 13
- 2021Demoting the Lead Bias in News Summarization via Alternating Adversarial Learningcited by 10
- 2021Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attributioncited by 10
- 2021TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Postscited by 10
- 2022Read Top News First: A Document Reordering Approach for Multi-Document News Summarizationcited by 9
- 2023Generating EDU Extracts for Plan-Guided Summary Re-Rankingcited by 9
- 2024Hierarchical Indexing for Retrieval-Augmented Opinion Summarizationcited by 7
- 2022NarraSum: A Large-Scale Dataset for Abstractive Narrative Summarizationcited by 5
- 2021Summary Explorer: Visualizing the State of the Art in Text Summarizationcited by 4
- 2024Understanding Position Bias Effects on Fairness in Social Multi-Document Summarizationcited by 4
- 2024Scaling Up Summarization: Leveraging Large Language Models for Long Text Extractive Summarizationcited by 4
- 2022Achieving Conversational Goals with Unsupervised Post-hoc Knowledge Injectioncited by 3
- 2022Sequence-Based Extractive Summarisation for Scientific Articlescited by 3
- 2025NUTSHELL: A Dataset for Abstract Generation from Scientific Talkscited by 3
- 2026When Bigger Isn't Better: A Comprehensive Fairness Evaluation of Political Bias in Multi-News Summarisationcited by 2
- 2026Measuring Alignment With Reader Highlights Net of Position and Lengthcited by 2
- 2021Unsupervised Extractive Summarization by Human Memory Simulationcited by 1
- 2021Analysis of GraphSum's Attention Weights to Improve the Explainability of Multi-Document Summarizationcited by 1
- 2022Text Summarization with Oracle Expectationcited by 1
- 2024Self-Supervised Position Debiasing for Large Language Modelscited by 1
- 2021SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysiscited by 0
- 2021VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Searchcited by 0
- 2021Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generationcited by 0
50 most cited of 64 All 64 (JSON)
- 2026Measuring Alignment With Reader Highlights Net of Position and Length30 Jul 2026
- 2026UTS at CheckThat! 2026: Cite-Frame Engineering for Generated Fact-Checking Articles15 Jul 2026
- 2026When Bigger Isn't Better: A Comprehensive Fairness Evaluation of Political Bias in Multi-News Summarisation23 Apr 2026
- 2026What Matters to an LLM? Behavioral and Computational Evidences from Summarization31 Jan 2026
- 2025Minimal Clips, Maximum Salience: Long Video Summarization via Key Moment Extraction12 Dec 2025
- 2025NUTSHELL: A Dataset for Abstract Generation from Scientific Talks24 Feb 2025
- 2024Scaling Up Summarization: Leveraging Large Language Models for Long Text Extractive Summarization28 Aug 2024
- 2024How to Train Text Summarization Model with Weak Supervisions27 Aug 2024
- 2024Understanding Position Bias Effects on Fairness in Social Multi-Document Summarization3 May 2024
- 2024Hierarchical Indexing for Retrieval-Augmented Opinion Summarization1 Mar 2024
- 2024Self-Supervised Position Debiasing for Large Language Models2 Jan 2024
- 2023A Survey on Out-of-Distribution Evaluation of Neural NLP Models27 Jun 2023
38 more
- 2023FinRED: A Dataset for Relation Extraction in Financial Domain6 Jun 2023
- 2023Generating EDU Extracts for Plan-Guided Summary Re-Ranking28 May 2023
- 2023VCSUM: A Versatile Chinese Meeting Summarization Dataset9 May 2023
- 2023A Suite of Generative Tasks for Multi-Level Multimodal Webpage Understanding5 May 2023
- 2023Unlimiformer: Long-Range Transformers with Unlimited Length Input2 May 2023
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGram16 Mar 2023
- 2022Towards Proactively Forecasting Sentence-Specific Information Popularity within Online News Documents31 Dec 2022
- 2022Extractive Text Summarization Using Generalized Additive Models with Interactions for Sentence Selection21 Dec 2022
- 2022A Survey on Medical Document Summarization3 Dec 2022
- 2022NarraSum: A Large-Scale Dataset for Abstractive Narrative Summarization2 Dec 2022
- 2022Toward Unifying Text Segmentation and Long Document Summarization28 Oct 2022
- 2022Legal Case Document Summarization: Extractive and Abstractive Methods and their Evaluation14 Oct 2022
- 2022Text Summarization with Oracle Expectation26 Sep 2022
- 2022Sparse Optimization for Unsupervised Extractive Summarization of Long Documents with the Frank-Wolfe Algorithm19 Aug 2022
- 2022Using Graph Neural Networks for Program Termination28 Jul 2022
- 2022Explanation-Guided Fairness Testing through Genetic Algorithm16 May 2022
- 2022Evaluation of Automatic Text Summarization using Synthetic Facts11 Apr 2022
- 2022Sequence-Based Extractive Summarisation for Scientific Articles7 Apr 2022
- 2022EntSUM: A Data Set for Entity-Centric Summarization5 Apr 2022
- 2022BRIO: Bringing Order to Abstractive Summarization31 Mar 2022
- 2022Achieving Conversational Goals with Unsupervised Post-hoc Knowledge Injection22 Mar 2022
- 2022Read Top News First: A Document Reordering Approach for Multi-Document News Summarization19 Mar 2022
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networks8 Mar 2022
- 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text14 Feb 2022
- 2022Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectors6 Feb 2022
- 2021InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation2 Dec 2021
- 2021TODSum: Task-Oriented Dialogue Summarization with State Tracking25 Oct 2021
- 2021End-to-End Segmentation-based News Summarization15 Oct 2021
- 2021TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Posts4 Oct 2021
- 2021Controllable Neural Dialogue Summarization with Personal Named Entity Planning27 Sep 2021
- 2021Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generation13 Sep 2021
- 2021StreamHover: Livestream Transcript Summarization and Annotation11 Sep 2021
- 2021Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarization31 Aug 2021
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenters27 Aug 2021
- 2021VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Search5 Aug 2021
- 2021Summary Explorer: Visualizing the State of the Art in Text Summarization4 Aug 2021
- 2021SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysis3 Aug 2021
- 2021Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution3 Jun 2021
50 newest of 64 All 64 (JSON)
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 365
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
- 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
- 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 155
- 2023Unlimiformer: Long-Range Transformers with Unlimited Length Inputcited by 128
- 2021Robustness Gym: Unifying the NLP Evaluation Landscapecited by 108
- 2021MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarizationcited by 104
- 2021Faithful or Extractive? On Mitigating the Faithfulness-Abstractiveness Trade-off in Abstractive Summarizationcited by 51
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
- 2021Controllable Neural Dialogue Summarization with Personal Named Entity Planningcited by 36
- 2021What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarizationcited by 35
12 most cited of 62 All 62 (JSON)
- 2026Measuring Alignment With Reader Highlights Net of Position and Length30 Jul 2026
- 2026UTS at CheckThat! 2026: Cite-Frame Engineering for Generated Fact-Checking Articles15 Jul 2026
- 2026When Bigger Isn't Better: A Comprehensive Fairness Evaluation of Political Bias in Multi-News Summarisation23 Apr 2026
- 2026What Matters to an LLM? Behavioral and Computational Evidences from Summarization31 Jan 2026
- 2025NUTSHELL: A Dataset for Abstract Generation from Scientific Talks24 Feb 2025
- 2024Scaling Up Summarization: Leveraging Large Language Models for Long Text Extractive Summarization28 Aug 2024
- 2024How to Train Text Summarization Model with Weak Supervisions27 Aug 2024
- 2024Understanding Position Bias Effects on Fairness in Social Multi-Document Summarization3 May 2024
- 2024Self-Supervised Position Debiasing for Large Language Models2 Jan 2024
- 2023A Survey on Out-of-Distribution Evaluation of Neural NLP Models27 Jun 2023
- 2023FinRED: A Dataset for Relation Extraction in Financial Domain6 Jun 2023
- 2023Generating EDU Extracts for Plan-Guided Summary Re-Ranking28 May 2023
12 newest of 62 All 62 (JSON)