Simple Unsupervised Summarization by Contextual Matching
Not on the map. Why?
Abstract (arXiv)
We propose an unsupervised method for sentence summarization using only language modeling. The approach employs two language models, one that is generic (i.e. pretrained), and the other that is specific to the target domain. We show that by using a product-of-experts criteria these are enough for maintaining continuous contextual matching while maintaining output fluency. Experiments on both abstractive and extractive sentence summarization data sets show promising results of our method without being exposed to any paired data.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 5; 2024: 2; 2025: 0; 2026: 1.
18 papers.
Sort:
By area:
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2023Discrete Prompt Compression with Reinforcement Learningcited by 42
- 2021ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument Miningcited by 37
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasingcited by 31
- 2021AMR Parsing with Action-Pointer Transformercited by 25
- 2021Unsupervised Extractive Summarization using Pointwise Mutual Informationcited by 23
- 2022Efficient Unsupervised Sentence Compression by Fine-tuning Transformers with Reinforcement Learningcited by 18
- 2022Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarizationcited by 12
- 2021LawSum: A weakly supervised approach for Indian Legal Document Summarizationcited by 6
- 2022Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarizationcited by 5
- 2022An Efficient Coarse-to-Fine Facet-Aware Unsupervised Summarization Framework based on Semantic Blockscited by 4
- 2024InstructCMP: Length Control in Sentence Compression through Instruction-based Large Language Modelscited by 4
6 more
- 2021With Measured Words: Simple Sentence Selection for Black-Box Optimization of Sentence Compression Algorithmscited by 2
- 2021Evaluation of Abstractive Summarisation Models with Machine Translation in Deliberative Processescited by 0
- 2023Recent Trends in Unsupervised Summarizationcited by 0
- 2023Unsupervised Open-domain Keyphrase Generationcited by 0
- 2023From Lengthy to Lucid: A Systematic Literature Review on NLP Techniques for Taming Long Sentencescited by 0
- 2026SinBrief: A Hybrid Framework for Abstractive Text Summarisation of Sinhala Legal Documentscited by 0
- 2026SinBrief: A Hybrid Framework for Abstractive Text Summarisation of Sinhala Legal Documents26 Sep 2026
- 2024InstructCMP: Length Control in Sentence Compression through Instruction-based Large Language Models16 Jun 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2023From Lengthy to Lucid: A Systematic Literature Review on NLP Techniques for Taming Long Sentences8 Dec 2023
- 2023Discrete Prompt Compression with Reinforcement Learning17 Aug 2023
- 2023Unsupervised Open-domain Keyphrase Generation19 Jun 2023
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasing26 May 2023
- 2023Recent Trends in Unsupervised Summarization18 May 2023
- 2022Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarization21 Dec 2022
- 2022An Efficient Coarse-to-Fine Facet-Aware Unsupervised Summarization Framework based on Semantic Blocks17 Aug 2022
- 2022Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarization28 May 2022
- 2022Efficient Unsupervised Sentence Compression by Fine-tuning Transformers with Reinforcement Learning17 May 2022
6 more
- 2021Evaluation of Abstractive Summarisation Models with Machine Translation in Deliberative Processes12 Oct 2021
- 2021LawSum: A weakly supervised approach for Indian Legal Document Summarization4 Oct 2021
- 2021ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument Mining1 Jun 2021
- 2021AMR Parsing with Action-Pointer Transformer29 Apr 2021
- 2021Unsupervised Extractive Summarization using Pointwise Mutual Information11 Feb 2021
- 2021With Measured Words: Simple Sentence Selection for Black-Box Optimization of Sentence Compression Algorithms25 Jan 2021
- 2023Discrete Prompt Compression with Reinforcement Learningcited by 42
- 2023Discrete Prompt Compression with Reinforcement Learning17 Aug 2023
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021ConvoSumm: Conversation Summarization Benchmark and Improved Abstractive Summarization with Argument Miningcited by 37
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasingcited by 31
- 2021AMR Parsing with Action-Pointer Transformercited by 25
- 2021Unsupervised Extractive Summarization using Pointwise Mutual Informationcited by 23
- 2022Efficient Unsupervised Sentence Compression by Fine-tuning Transformers with Reinforcement Learningcited by 18
- 2022Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarizationcited by 12
- 2021LawSum: A weakly supervised approach for Indian Legal Document Summarizationcited by 6
- 2022Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarizationcited by 5
- 2022An Efficient Coarse-to-Fine Facet-Aware Unsupervised Summarization Framework based on Semantic Blockscited by 4
- 2024InstructCMP: Length Control in Sentence Compression through Instruction-based Large Language Modelscited by 4
- 2021With Measured Words: Simple Sentence Selection for Black-Box Optimization of Sentence Compression Algorithmscited by 2
12 most cited of 17 All 17 (JSON)
- 2026SinBrief: A Hybrid Framework for Abstractive Text Summarisation of Sinhala Legal Documents26 Sep 2026
- 2024InstructCMP: Length Control in Sentence Compression through Instruction-based Large Language Models16 Jun 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2023From Lengthy to Lucid: A Systematic Literature Review on NLP Techniques for Taming Long Sentences8 Dec 2023
- 2023Unsupervised Open-domain Keyphrase Generation19 Jun 2023
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasing26 May 2023
- 2023Recent Trends in Unsupervised Summarization18 May 2023
- 2022Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarization21 Dec 2022
- 2022An Efficient Coarse-to-Fine Facet-Aware Unsupervised Summarization Framework based on Semantic Blocks17 Aug 2022
- 2022Learning Non-Autoregressive Models from Search for Unsupervised Sentence Summarization28 May 2022
- 2022Efficient Unsupervised Sentence Compression by Fine-tuning Transformers with Reinforcement Learning17 May 2022
- 2021Evaluation of Abstractive Summarisation Models with Machine Translation in Deliberative Processes12 Oct 2021
12 newest of 17 All 17 (JSON)