Searching for Effective Neural Extractive Summarization: What Works and What's Next
Not on the map. Why?
Abstract (arXiv)
The recent years have seen remarkable success in the use of deep neural networks on text summarization. However, there is no clear understanding of textitwhy they perform so well, or textithow they might be improved. In this paper, we seek to better understand how neural extractive summarization systems could benefit from different types of model architectures, transferable knowledge and learning schemas. Additionally, we find an effective way to improve current frameworks and achieve the state-of-the-art result on CNN/DailyMail by a large margin based on our observations and analyses. Hopefully, our work could provide more clues for future research on extractive summarization.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 13; 2023: 5; 2024: 5; 2025: 1; 2026: 1.
38 papers.
Sort:
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
- 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
- 2022Evaluating the Factual Consistency of Large Language Models Through News Summarizationcited by 90
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
- 2021InfoLM: A New Metric to Evaluate Summarization & Data2Text Generationcited by 33
- 2022Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarizationcited by 32
- 2021RefSum: Refactoring Neural Summarizationcited by 25
- 2023DiffuSum: Generation Enhanced Extractive Summarization with Diffusioncited by 25
- 2021Multiplex Graph Neural Network for Extractive Text Summarizationcited by 19
- 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarizationcited by 19
- 2021A Pseudo-Metric between Probability Distributions based on Depth-Trimmed Regionscited by 17
26 more
- 2022Discharge Summary Hospital Course Summarisation of In Patient Electronic Health Record Text with Clinical Concept Guided Deep Pre-Trained Transformer Modelscited by 17
- 2021How well do you know your summarization datasets?cited by 16
- 2021Enhancing Scientific Papers Summarization with Citation Graphcited by 14
- 2022Salience Allocation as Guidance for Abstractive Summarizationcited by 14
- 2021Demoting the Lead Bias in News Summarization via Alternating Adversarial Learningcited by 10
- 2021Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attributioncited by 10
- 2022Read Top News First: A Document Reordering Approach for Multi-Document News Summarizationcited by 9
- 2022Capturing Global Structural Information in Long Document Question Answering with Compressive Graph Selector Networkcited by 9
- 2022COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarizationcited by 8
- 2024Eguard: Defending LLM Embeddings Against Inversion Attacks via Text Mutual Information Optimizationcited by 8
- 2021SummerTime: Text Summarization Toolkit for Non-expertscited by 6
- 2023The Current State of Summarizationcited by 6
- 2022Unsupervised Multi-Granularity Summarizationcited by 5
- 2022NarraSum: A Large-Scale Dataset for Abstractive Narrative Summarizationcited by 5
- 2024Incremental Extractive Opinion Summarization Using Cover Treescited by 4
- 2022Universal Evasion Attacks on Summarization Scoringcited by 2
- 2022Towards Understanding Omission in Dialogue Summarizationcited by 2
- 2024Benchmarking LLMs on the Semantic Overlap Summarization Taskcited by 2
- 2025Fact-Preserved Personalized News Headline Generationcited by 2
- 2023An entity-guided text summarization framework with relational heterogeneous graph neural networkcited by 1
- 2024Reward-based Input Construction for Cross-document Relation Extractioncited by 1
- 2026Measuring Alignment With Reader Highlights Net of Position and Lengthcited by 1
- 2022Multi-Narrative Semantic Overlap Task: Evaluation and Benchmarkcited by 0
- 2023Stress Testing BERT Anaphora Resolution Models for Reaction Extraction in Chemical Patentscited by 0
- 2023Inducing Causal Structure for Abstractive Text Summarizationcited by 0
- 2024Investigating Consistency in Query-Based Meeting Summarization: A Comparative Study of Different Embedding Methodscited by 0
- 2026Measuring Alignment With Reader Highlights Net of Position and Length30 Jul 2026
- 2025Fact-Preserved Personalized News Headline Generation21 Jan 2025
- 2024Eguard: Defending LLM Embeddings Against Inversion Attacks via Text Mutual Information Optimization6 Nov 2024
- 2024Reward-based Input Construction for Cross-document Relation Extraction31 May 2024
- 2024Benchmarking LLMs on the Semantic Overlap Summarization Task26 Feb 2024
- 2024Investigating Consistency in Query-Based Meeting Summarization: A Comparative Study of Different Embedding Methods10 Feb 2024
- 2024Incremental Extractive Opinion Summarization Using Cover Trees16 Jan 2024
- 2023Inducing Causal Structure for Abstractive Text Summarization24 Aug 2023
- 2023Stress Testing BERT Anaphora Resolution Models for Reaction Extraction in Chemical Patents23 Jun 2023
- 2023The Current State of Summarization8 May 2023
- 2023DiffuSum: Generation Enhanced Extractive Summarization with Diffusion2 May 2023
- 2023An entity-guided text summarization framework with relational heterogeneous graph neural network7 Feb 2023
26 more
- 2022NarraSum: A Large-Scale Dataset for Abstractive Narrative Summarization2 Dec 2022
- 2022Evaluating the Factual Consistency of Large Language Models Through News Summarization15 Nov 2022
- 2022Towards Understanding Omission in Dialogue Summarization14 Nov 2022
- 2022Discharge Summary Hospital Course Summarisation of In Patient Electronic Health Record Text with Clinical Concept Guided Deep Pre-Trained Transformer Models14 Nov 2022
- 2022Universal Evasion Attacks on Summarization Scoring25 Oct 2022
- 2022Salience Allocation as Guidance for Abstractive Summarization22 Oct 2022
- 2022Towards a Unified Multi-Dimensional Evaluator for Text Generation13 Oct 2022
- 2022Capturing Global Structural Information in Long Document Question Answering with Compressive Graph Selector Network11 Oct 2022
- 2022COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization29 Sep 2022
- 2022Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarization8 Sep 2022
- 2022Read Top News First: A Document Reordering Approach for Multi-Document News Summarization19 Mar 2022
- 2022Unsupervised Multi-Granularity Summarization29 Jan 2022
- 2022Multi-Narrative Semantic Overlap Task: Evaluation and Benchmark14 Jan 2022
- 2021InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation2 Dec 2021
- 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarization16 Sep 2021
- 2021Multiplex Graph Neural Network for Extractive Text Summarization29 Aug 2021
- 2021SummerTime: Text Summarization Toolkit for Non-experts29 Aug 2021
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenters27 Aug 2021
- 2021BARTScore: Evaluating Generated Text as Text Generation22 Jun 2021
- 2021How well do you know your summarization datasets?21 Jun 2021
- 2021Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution3 Jun 2021
- 2021Demoting the Lead Bias in News Summarization via Alternating Adversarial Learning29 May 2021
- 2021RefSum: Refactoring Neural Summarization15 Apr 2021
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization13 Apr 2021
- 2021Enhancing Scientific Papers Summarization with Citation Graph7 Apr 2021
- 2021A Pseudo-Metric between Probability Distributions based on Depth-Trimmed Regions23 Mar 2021
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
- 2022Towards a Unified Multi-Dimensional Evaluator for Text Generationcited by 264
- 2022Evaluating the Factual Consistency of Large Language Models Through News Summarizationcited by 90
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
- 2021InfoLM: A New Metric to Evaluate Summarization & Data2Text Generationcited by 33
- 2022Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarizationcited by 32
- 2021RefSum: Refactoring Neural Summarizationcited by 25
- 2023DiffuSum: Generation Enhanced Extractive Summarization with Diffusioncited by 25
- 2021Multiplex Graph Neural Network for Extractive Text Summarizationcited by 19
- 2021RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarizationcited by 19
- 2021A Pseudo-Metric between Probability Distributions based on Depth-Trimmed Regionscited by 17
12 most cited of 38 All 38 (JSON)
- 2026Measuring Alignment With Reader Highlights Net of Position and Length30 Jul 2026
- 2025Fact-Preserved Personalized News Headline Generation21 Jan 2025
- 2024Eguard: Defending LLM Embeddings Against Inversion Attacks via Text Mutual Information Optimization6 Nov 2024
- 2024Reward-based Input Construction for Cross-document Relation Extraction31 May 2024
- 2024Benchmarking LLMs on the Semantic Overlap Summarization Task26 Feb 2024
- 2024Investigating Consistency in Query-Based Meeting Summarization: A Comparative Study of Different Embedding Methods10 Feb 2024
- 2024Incremental Extractive Opinion Summarization Using Cover Trees16 Jan 2024
- 2023Inducing Causal Structure for Abstractive Text Summarization24 Aug 2023
- 2023Stress Testing BERT Anaphora Resolution Models for Reaction Extraction in Chemical Patents23 Jun 2023
- 2023The Current State of Summarization8 May 2023
- 2023DiffuSum: Generation Enhanced Extractive Summarization with Diffusion2 May 2023
- 2023An entity-guided text summarization framework with relational heterogeneous graph neural network7 Feb 2023
12 newest of 38 All 38 (JSON)