Bottom-Up Abstractive Summarization
Not on the map. Why?
Abstract (arXiv)
Neural network-based methods for abstractive summarization produce outputs that are more fluent than other techniques, but which can be poor at content selection. This work proposes a simple technique for addressing this issue: use a data-efficient content selector to over-determine phrases in a source document that should be part of the summary. We use this selector as a bottom-up attention step to constrain the model to likely phrases. We show that this approach improves the ability to compress text, while still generating fluent summaries. This two-step process is both simpler and higher performing than other end-to-end content selection models, leading to significant improvements on ROUGE for both the CNN-DM and NYT corpus. Furthermore, the content selector can be trained with as little as 1,000 sentences, making it easy to transfer a trained summarizer to a new domain.
Key facts. Cited by 177 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 75; 2022: 48; 2023: 27; 2024: 15; 2025: 9; 2026: 2.
177 papers.
Sort:
By area:
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
- 2021Efficient Attentions for Long Document Summarizationcited by 342
- 2021Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metricscited by 285
- 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 181
- 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
- 2022Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectorscited by 103
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
- 2023Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Methodcited by 76
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
38 more
- 2021Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documentscited by 64
- 2021Can We Automate Scientific Reviewing?cited by 63
- 2021PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarizationcited by 62
- 2024Attribute First, then Generate: Locally-attributable Grounded Text Generationcited by 54
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2021AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarizationcited by 51
- 2021D2S: Document-to-Slide Generation Via Query-Based Text Summarizationcited by 48
- 2022Conditional Generation with a Question-Answering Blueprintcited by 44
- 2022Prompted Opinion Summarization with GPT-3.5cited by 44
- 2022Long Document Summarization with Top-down and Bottom-up Inferencecited by 42
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
- 2022Correcting Diverse Factual Errors in Abstractive Summarization via Post-Editing and Language Model Infillingcited by 38
- 2021Factual Consistency Evaluation for Text Summarization via Counterfactual Estimationcited by 37
- 2022Submodularity In Machine Learning and Artificial Intelligencecited by 37
- 2022ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generationcited by 37
- 2021Controllable Neural Dialogue Summarization with Personal Named Entity Planningcited by 36
- 2021What's in a Summary? Laying the Groundwork for Advances in Hospital-Course Summarizationcited by 35
- 2021InfoLM: A New Metric to Evaluate Summarization & Data2Text Generationcited by 33
- 2021Bidimensional Leaderboards: Generate and Evaluate Language Hand in Handcited by 32
- 2022Extractive is not Faithful: An Investigation of Broad Unfaithfulness Problems in Extractive Summarizationcited by 32
- 2021Sequence Level Contrastive Learning for Text Summarizationcited by 31
- 2021Focus Attention: Promoting Faithfulness and Diversity in Summarizationcited by 30
- 2023MQAG: Multiple-choice Question Answering and Generation for Assessing Information Consistency in Summarizationcited by 30
- 2021The Summary Loop: Learning to Write Abstractive Summaries Without Examplescited by 27
- 2021Controllable Abstractive Dialogue Summarization with Sketch Supervisioncited by 27
- 2022Towards Improving Faithfulness in Abstractive Summarizationcited by 27
- 2022ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generationcited by 26
- 2022Spurious Correlations in Reference-Free Evaluation of Text Generationcited by 26
- 2021RefSum: Refactoring Neural Summarizationcited by 25
- 2021Learning Opinion Summarizers by Selecting Informative Reviewscited by 25
- 2021Long Document Summarization in a Low Resource Setting using Pretrained Language Modelscited by 24
- 2021Long-Span Summarization via Local Attention and Content Selectioncited by 24
- 2021Topic-Aware Contrastive Learning for Abstractive Dialogue Summarizationcited by 23
- 2024Fine-Grained Natural Language Inference Based Faithfulness Evaluation for Diverse Summarisation Taskscited by 23
- 2021BASS: Boosting Abstractive Summarization with Unified Semantic Graphcited by 21
- 2021Enriching and Controlling Global Semantics for Text Summarizationcited by 20
- 2022Faithful to the Document or to the World? Mitigating Hallucinations via Entity-linked Knowledge in Abstractive Summarizationcited by 20
- 2021Topic-Guided Abstractive Multi-Document Summarizationcited by 19
50 most cited of 177 All 177 (JSON)
- 2026LOOMSUM:Weaving Quantitative and Narrative Evidence for Faithful Long Text-Table Summarization31 Aug 2026
- 2026Multilingual Sentiment Aware Text Summarization A Reinforcement Learning Approach for Consistency Maintenance8 Jun 2026
- 2025Enhancing Long Document Long Form Summarisation with Self-Planning19 Dec 2025
- 2025Minimal Clips, Maximum Salience: Long Video Summarization via Key Moment Extraction12 Dec 2025
- 2025BiSparse-AAS: Bilinear Sparse Attention and Adaptive Spans Framework for Scalable and Efficient Text Summarization31 Oct 2025
- 2025Document Summarization with Conformal Importance Guarantees24 Sep 2025
- 2025MRGSEM-Sum: An Unsupervised Multi-document Summarization Framework based on Multi-Relational Graphs and Structural Entropy Minimization31 Jul 2025
- 2025Data Transformation Strategies to Remove Heterogeneity16 Jul 2025
- 2025Sentence Embeddings as an intermediate target in end-to-end summarisation6 May 2025
- 2025Self-Vocabularizing Training for Neural Machine Translation18 Mar 2025
- 2025Behavioral Analysis of Information Salience in Large Language Models20 Feb 2025
- 2024MARS: Multilingual Aspect-centric Review Summarisation13 Oct 2024
38 more
- 2024GlobeSumm: A Challenging Benchmark Towards Unifying Multi-lingual, Cross-lingual and Multi-document News Summarization5 Oct 2024
- 2024How to Train Text Summarization Model with Weak Supervisions27 Aug 2024
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models17 Jun 2024
- 2024Write Summary Step-by-Step: A Pilot Study of Stepwise Summarization8 Jun 2024
- 2024Guiding ChatGPT to Generate Salient Domain Summaries3 Jun 2024
- 2024Label-Free Topic-Focused Summarization Using Query Augmentation25 Apr 2024
- 2024Select and Summarize: Scene Saliency for Movie Script Summarization4 Apr 2024
- 2024Attribute First, then Generate: Locally-attributable Grounded Text Generation25 Mar 2024
- 2024Multi-Review Fusion-in-Context22 Mar 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2024Fine-Grained Natural Language Inference Based Faithfulness Evaluation for Diverse Summarisation Tasks27 Feb 2024
- 2024Factual consistency evaluation of summarization in the Era of large language models21 Feb 2024
- 2024Analysis of Multidomain Abstractive Summarization Using Salience Allocation19 Feb 2024
- 2024Bridging Research and Readers: A Multi-Modal Automated Academic Papers Interpretation System17 Jan 2024
- 2023Exploiting Representation Bias for Data Distillation in Abstractive Text Summarization10 Dec 2023
- 2023Controllable Topic-Focused Abstractive Summarization12 Nov 2023
- 2023Inducing Causal Structure for Abstractive Text Summarization24 Aug 2023
- 2023Fusing Multimodal Signals on Hyper-complex Space for Extreme Abstractive Text Summarization (TL;DR) of Scientific Contents24 Jun 2023
- 2023Absformer: Transformer-based Model for Unsupervised Multi-Document Abstractive Summarization7 Jun 2023
- 2023Echoes from Alexandria: A Large Resource for Multilingual Book Summarization7 Jun 2023
- 2023Injecting knowledge into language generation: a case study in auto-charting after-visit care instructions from medical dialogue6 Jun 2023
- 2023AaKOS: Aspect-adaptive Knowledge-based Opinion Summarization26 May 2023
- 2023Domain Aligned Prefix Averaging for Domain Generalization in Abstractive Summarization26 May 2023
- 2023Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method22 May 2023
- 2023Evaluating Factual Consistency of Texts with Semantic Role Labeling22 May 2023
- 2023LMGQS: A Large-scale Dataset for Query-focused Summarization22 May 2023
- 2023NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist15 May 2023
- 2023A Hierarchical Encoding-Decoding Scheme for Abstractive Multi-document Summarization15 May 2023
- 2023PROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization11 May 2023
- 2023A Method to Automate the Discharge Summary Hospital Course for Neurology Patients10 May 2023
- 2023Enhancing Automated Program Repair through Fine-tuning and Prompt Engineering16 Apr 2023
- 2023GEMINI: Controlling the Sentence-level Writing Style for Abstractive Text Summarization7 Apr 2023
- 2023Mining both Commonality and Specificity from Multiple Documents for Multi-Document Summarization5 Mar 2023
- 2023Generating a Structured Summary of Numerous Academic Papers: Dataset and Method9 Feb 2023
- 2023An entity-guided text summarization framework with relational heterogeneous graph neural network7 Feb 2023
- 2023Curriculum-Guided Abstractive Summarization2 Feb 2023
- 2023Curriculum-guided Abstractive Summarization for Mental Health Online Posts2 Feb 2023
- 2023HunSum-1: an Abstractive Summarization Dataset for Hungarian1 Feb 2023
50 newest of 177 All 177 (JSON)
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
- 2021Efficient Attentions for Long Document Summarizationcited by 342
- 2021Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metricscited by 285
- 2021DialogSum: A Real-Life Scenario Dialogue Summarization Datasetcited by 181
- 2022Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Textcited by 154
- 2022Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectorscited by 103
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
- 2021Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documentscited by 64
- 2021Can We Automate Scientific Reviewing?cited by 63
12 most cited of 172 All 172 (JSON)
- 2026LOOMSUM:Weaving Quantitative and Narrative Evidence for Faithful Long Text-Table Summarization31 Aug 2026
- 2025Enhancing Long Document Long Form Summarisation with Self-Planning19 Dec 2025
- 2025BiSparse-AAS: Bilinear Sparse Attention and Adaptive Spans Framework for Scalable and Efficient Text Summarization31 Oct 2025
- 2025Document Summarization with Conformal Importance Guarantees24 Sep 2025
- 2025MRGSEM-Sum: An Unsupervised Multi-document Summarization Framework based on Multi-Relational Graphs and Structural Entropy Minimization31 Jul 2025
- 2025Data Transformation Strategies to Remove Heterogeneity16 Jul 2025
- 2025Sentence Embeddings as an intermediate target in end-to-end summarisation6 May 2025
- 2025Self-Vocabularizing Training for Neural Machine Translation18 Mar 2025
- 2025Behavioral Analysis of Information Salience in Large Language Models20 Feb 2025
- 2024MARS: Multilingual Aspect-centric Review Summarisation13 Oct 2024
- 2024GlobeSumm: A Challenging Benchmark Towards Unifying Multi-lingual, Cross-lingual and Multi-document News Summarization5 Oct 2024
- 2024How to Train Text Summarization Model with Weak Supervisions27 Aug 2024
12 newest of 172 All 172 (JSON)