Neural Summarization by Extracting Sentences and Words
Not on the map. Why?
Abstract (arXiv)
Traditional approaches to extractive summarization rely heavily on human-engineered features. In this work we propose a data-driven approach based on neural networks and continuous sentence features. We develop a general framework for single-document summarization composed of a hierarchical document encoder and an attention-based extractor. This architecture allows us to develop different classes of summarization models which can extract sentences or words. We train our models on large scale corpora containing hundreds of thousands of document-summary pairs. Experimental results on two summarization datasets demonstrate that our models obtain results comparable to the state of the art without any access to linguistic annotation.
Key facts. Cited by 114 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 24; 2023: 28; 2024: 15; 2025: 11; 2026: 2.
114 papers.
Sort:
By area:
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
- 2021Decontextualization: Making Sentences Stand-Alonecited by 101
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2023The Curious Decline of Linguistic Diversity: Training Language Models on Synthetic Textcited by 97
- 2021Protecting Intellectual Property of Language Generation APIs with Lexical Watermarkcited by 78
- 2025Lifelong Learning of Large Language Model based Agents: A Roadmapcited by 78
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
- 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 68
- 2023Align and Attend: Multimodal Summarization with Dual Contrastive Lossescited by 65
- 2023XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Modelscited by 61
- 2023Extractive Summarization via ChatGPT for Faithful Summary Generationcited by 58
- 2023SummIt: Iterative Text Summarization via ChatGPTcited by 53
38 more
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2023Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articlescited by 45
- 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decodercited by 44
- 2022Long Document Summarization with Top-down and Bottom-up Inferencecited by 42
- 2021Paradigm Shift in Natural Language Processingcited by 39
- 2022HEGEL: Hypergraph Transformer for Long Document Summarizationcited by 28
- 2022HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Informationcited by 26
- 2023DiffuSum: Generation Enhanced Extractive Summarization with Diffusioncited by 25
- 2021Long Document Summarization in a Low Resource Setting using Pretrained Language Modelscited by 24
- 2021Long-Span Summarization via Local Attention and Content Selectioncited by 24
- 2021Incorporating Domain Knowledge for Extractive Summarization of Legal Case Documentscited by 23
- 2021Topic-Aware Contrastive Learning for Abstractive Dialogue Summarizationcited by 23
- 2021Convex Aggregation for Opinion Summarizationcited by 21
- 2022CoNT: Contrastive Neural Text Generationcited by 21
- 2022Retrieval augmentation of large language models for lay language generationcited by 21
- 2021Multiplex Graph Neural Network for Extractive Text Summarizationcited by 19
- 2021Data Augmentation for Abstractive Query-Focused Multi-Document Summarizationcited by 18
- 2021See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarizationcited by 18
- 2022Unsupervised Extractive Opinion Summarization Using Sparse Codingcited by 17
- 2024EXIT: Context-Aware Extractive Compression for Enhancing Retrieval-Augmented Generationcited by 17
- 2021End-to-End Segmentation-based News Summarizationcited by 16
- 2022An Extractive-and-Abstractive Framework for Source Code Summarizationcited by 15
- 2021Text Compression-aided Transformer Encodingcited by 13
- 2021Leveraging Information Bottleneck for Scientific Document Summarizationcited by 13
- 2022MACSum: Controllable Summarization with Mixed Attributescited by 13
- 2023CopyNE: Better Contextual ASR by Copying Named Entitiescited by 13
- 2023MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videoscited by 12
- 2021Demoting the Lead Bias in News Summarization via Alternating Adversarial Learningcited by 10
- 2022Questioning the Validity of Summarization Datasets and Improving Their Factual Consistencycited by 9
- 2023Contrastive Hierarchical Discourse Graph for Scientific Document Summarizationcited by 9
- 2024Structsum Generation for Faster Text Comprehensioncited by 9
- 2024Select and Summarize: Scene Saliency for Movie Script Summarizationcited by 9
- 2021Contextualized Rewriting for Text Summarizationcited by 8
- 2022COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarizationcited by 8
- 2023Neural Natural Language Processing for Long Texts: A Survey on Classification and Summarizationcited by 7
- 2023Fusing Multimodal Signals on Hyper-complex Space for Extreme Abstractive Text Summarization (TL;DR) of Scientific Contentscited by 7
- 2021Nutri-bullets: Summarizing Health Studies by Composing Segmentscited by 6
- 2021LawSum: A weakly supervised approach for Indian Legal Document Summarizationcited by 6
50 most cited of 114 All 114 (JSON)
- 2026Learning to Control Summaries with Score Ranking19 Apr 2026
- 2026Not Worth Mentioning? A Pilot Study on Salient Proposition Annotation28 Mar 2026
- 2025Leveraging Digitized Newspapers to Collect Summarization Data in Low-Resource Languages18 Nov 2025
- 2025AraFinNews: Arabic Financial Summarisation with Domain-Adapted LLMs3 Nov 2025
- 2025Efficient Extractive Text Summarization for Online News Articles Using Machine Learning19 Sep 2025
- 2025TracSum: A New Benchmark for Aspect-Based Summarization with Sentence-Level Traceability in Medical Domain19 Aug 2025
- 2025Data Transformation Strategies to Remove Heterogeneity16 Jul 2025
- 2025GenerationPrograms: Fine-grained Attribution with Executable Programs17 Jun 2025
- 2025Principled Content Selection to Generate Diverse and Personalized Multi-Document Summaries28 May 2025
- 2025Beyond One-Size-Fits-All Summarization: Customizing Summaries for Diverse Users10 Mar 2025
- 2025OrderSum: Semantic Sentence Ordering for Extractive Summarization22 Feb 2025
- 2025A Comprehensive Survey on Legal Summarization: Challenges and Future Directions29 Jan 2025
38 more
- 2025Lifelong Learning of Large Language Model based Agents: A Roadmap13 Jan 2025
- 2024EXIT: Context-Aware Extractive Compression for Enhancing Retrieval-Augmented Generation17 Dec 2024
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024Systematic Exploration of Dialogue Summarization Approaches for Reproducibility, Comparative Assessment, and Methodological Innovations for Advancing Natural Language Processing in Abstractive Summarization21 Oct 2024
- 2024MARS: Multilingual Aspect-centric Review Summarisation13 Oct 2024
- 2024AlignSum: Data Pyramid Hierarchical Fine-tuning for Aligning with Human Summarization Preference1 Oct 2024
- 2024CTISum: A New Benchmark Dataset For Cyber Threat Intelligence Summarization13 Aug 2024
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models17 Jun 2024
- 2024Reward-based Input Construction for Cross-document Relation Extraction31 May 2024
- 2024Auto FAQ Generation13 May 2024
- 2024Select and Summarize: Scene Saliency for Movie Script Summarization4 Apr 2024
- 2024From News to Summaries: Building a Hungarian Corpus for Extractive and Abstractive Summarization4 Apr 2024
- 2024Modeling Unified Semantic Discourse Structure for High-quality Headline Generation23 Mar 2024
- 2024Pointer-Generator Networks for Low-Resource Machine Translation: Don't Copy That!16 Mar 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2024Structsum Generation for Faster Text Comprehension12 Jan 2024
- 2023Coreference Graph Guidance for Mind-Map Generation19 Dec 2023
- 2023The Curious Decline of Linguistic Diversity: Training Language Models on Synthetic Text16 Nov 2023
- 2023Automatic News Summerization17 Oct 2023
- 2023Low Resource Summarization using Pre-trained Language Models4 Oct 2023
- 2023Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articles17 Sep 2023
- 2023Unsupervised Multi-document Summarization with Holistic Inference8 Sep 2023
- 2023BUS:Efficient and Effective Vision-language Pre-training with Bottom-Up Patch Summarization17 Jul 2023
- 2023On Conditional and Compositional Language Model Differentiable Prompting4 Jul 2023
- 2023Fusing Multimodal Signals on Hyper-complex Space for Extreme Abstractive Text Summarization (TL;DR) of Scientific Contents24 Jun 2023
- 2023XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models13 Jun 2023
- 2023MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos7 Jun 2023
- 2023FinRED: A Dataset for Relation Extraction in Financial Domain6 Jun 2023
- 2023Efficient and Interpretable Compressive Text Summarisation with Unsupervised Dual-Agent Reinforcement Learning6 Jun 2023
- 2023Contrastive Hierarchical Discourse Graph for Scientific Document Summarization31 May 2023
- 2023Neural Natural Language Processing for Long Texts: A Survey on Classification and Summarization25 May 2023
- 2023SummIt: Iterative Text Summarization via ChatGPT24 May 2023
- 2023Enhancing Coherence of Extractive Summarization with Multitask Learning22 May 2023
- 2023CopyNE: Better Contextual ASR by Copying Named Entities22 May 2023
- 2023DiffuSum: Generation Enhanced Extractive Summarization with Diffusion2 May 2023
- 2023Extractive Summarization via ChatGPT for Faithful Summary Generation9 Apr 2023
- 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder8 Apr 2023
- 2023GEMINI: Controlling the Sentence-level Writing Style for Abstractive Text Summarization7 Apr 2023
50 newest of 114 All 114 (JSON)
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
- 2021Decontextualization: Making Sentences Stand-Alonecited by 101
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2023The Curious Decline of Linguistic Diversity: Training Language Models on Synthetic Textcited by 97
- 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
- 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 68
- 2023Align and Attend: Multimodal Summarization with Dual Contrastive Lossescited by 65
- 2023Extractive Summarization via ChatGPT for Faithful Summary Generationcited by 58
- 2023SummIt: Iterative Text Summarization via ChatGPTcited by 53
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2023Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articlescited by 45
- 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decodercited by 44
12 most cited of 108 All 108 (JSON)
- 2026Learning to Control Summaries with Score Ranking19 Apr 2026
- 2026Not Worth Mentioning? A Pilot Study on Salient Proposition Annotation28 Mar 2026
- 2025Leveraging Digitized Newspapers to Collect Summarization Data in Low-Resource Languages18 Nov 2025
- 2025AraFinNews: Arabic Financial Summarisation with Domain-Adapted LLMs3 Nov 2025
- 2025Efficient Extractive Text Summarization for Online News Articles Using Machine Learning19 Sep 2025
- 2025TracSum: A New Benchmark for Aspect-Based Summarization with Sentence-Level Traceability in Medical Domain19 Aug 2025
- 2025Data Transformation Strategies to Remove Heterogeneity16 Jul 2025
- 2025GenerationPrograms: Fine-grained Attribution with Executable Programs17 Jun 2025
- 2025Principled Content Selection to Generate Diverse and Personalized Multi-Document Summaries28 May 2025
- 2025Beyond One-Size-Fits-All Summarization: Customizing Summaries for Diverse Users10 Mar 2025
- 2025OrderSum: Semantic Sentence Ordering for Extractive Summarization22 Feb 2025
- 2025A Comprehensive Survey on Legal Summarization: Challenges and Future Directions29 Jan 2025
12 newest of 108 All 108 (JSON)