# Simple Unsupervised Keyphrase Extraction using Sentence Embeddings

arXiv: https://arxiv.org/abs/1801.04470 · HTML: https://mlsanity.com/paper/1801.04470/

## Key facts

- Cited by 62 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Jan 2018.

## Built on by (most cited first, 30 of 62)

- [Open-world Story Generation with Structured Knowledge Enhancement: A Comprehensive Survey](https://mlsanity.com/paper/2212.04634/) (2022)
- [MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extraction](https://mlsanity.com/paper/2110.06651/) (2021)
- [PatternRank: Leveraging Pretrained Language Models and Part of Speech for Unsupervised Keyphrase Extraction](https://mlsanity.com/paper/2210.05245/) (2022)
- [Unsupervised Keyphrase Extraction by Jointly Modeling Local and Global Context](https://mlsanity.com/paper/2109.07293/) (2021)
- [Representation Learning for Resource-Constrained Keyphrase Generation](https://mlsanity.com/paper/2203.08118/) (2022)
- [Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study](https://mlsanity.com/paper/2212.10233/) (2022)
- [ChatGPT vs State-of-the-Art Models: A Benchmarking Study in Keyphrase Generation Task](https://mlsanity.com/paper/2304.14177/) (2023)
- [Unsupervised Slot Schema Induction for Task-oriented Dialog](https://mlsanity.com/paper/2205.04515/) (2022)
- [Automatic Analysis of Available Source Code of Top Artificial Intelligence Conference Papers](https://mlsanity.com/paper/2209.14155/) (2022)
- [Cross-View Meets Diffusion: Aerial Image Synthesis with Geometry and Text Guidance](https://mlsanity.com/paper/2408.04224/) (2024)
- [Recurrent Attention-based Token Selection for Efficient Streaming Video-LLMs](https://mlsanity.com/paper/2510.17364/) (2025)
- [LLM-TAKE: Theme Aware Keyword Extraction Using Large Language Models](https://mlsanity.com/paper/2312.00909/) (2023)
- [Unsupervised Deep Keyphrase Generation](https://mlsanity.com/paper/2104.08729/) (2021)
- [Out of Thin Air: Is Zero-Shot Cross-Lingual Keyword Detection Better Than Unsupervised?](https://mlsanity.com/paper/2202.06650/) (2022)
- [LeCoPCR: Legal Concept-guided Prior Case Retrieval for European Court of Human Rights cases](https://mlsanity.com/paper/2501.14114/) (2025)
- [KPEval: Towards Fine-Grained Semantic-Based Keyphrase Evaluation](https://mlsanity.com/paper/2303.15422/) (2023)
- [SimCKP: Simple Contrastive Learning of Keyphrase Representations](https://mlsanity.com/paper/2310.08221/) (2023)
- [DistillCSE: Distilled Contrastive Learning for Sentence Embeddings](https://mlsanity.com/paper/2310.13499/) (2023)
- [Large Language Models as Zero-Shot Keyphrase Extractors: A Preliminary Empirical Study](https://mlsanity.com/paper/2312.15156/) (2023)
- [Theme-driven Keyphrase Extraction to Analyze Social Media Discourse](https://mlsanity.com/paper/2301.11508/) (2023)
- [Enhancing Keyphrase Extraction from Long Scientific Documents using Graph Embeddings](https://mlsanity.com/paper/2305.09316/) (2023)
- [Enhancing Keyphrase Generation by BART Finetuning with Splitting and Shuffling](https://mlsanity.com/paper/2309.06726/) (2023)
- [On Leveraging Encoder-only Pre-trained Language Models for Effective Keyphrase Generation](https://mlsanity.com/paper/2402.14052/) (2024)
- [A Preliminary Empirical Study on Prompt-based Unsupervised Keyphrase Extraction](https://mlsanity.com/paper/2405.16571/) (2024)
- [uMedSum: A Unified Framework for Advancing Medical Abstractive Summarization](https://mlsanity.com/paper/2408.12095/) (2024)
- [Pre-Trained Language Models for Keyphrase Prediction: A Review](https://mlsanity.com/paper/2409.01087/) (2024)
- [EntropyRank: Unsupervised Keyphrase Extraction via Side-Information Optimization for Language Model-based Text Compression](https://mlsanity.com/paper/2308.13399/) (2023)
- [A Hybrid Approach To Aspect Based Sentiment Analysis Using Transfer Learning](https://mlsanity.com/paper/2403.17254/) (2024)
- [An Improved Method for Class-specific Keyword Extraction: A Case Study in the German Business Registry](https://mlsanity.com/paper/2407.14085/) (2024)
- [ChuLo: Chunk-Level Key Information Representation for Long Document Understanding](https://mlsanity.com/paper/2410.11119/) (2024)

## Abstract (arXiv)

Keyphrase extraction is the task of automatically selecting a small set of phrases that best describe a given free text document. Supervised keyphrase extraction requires large amounts of labeled training data and generalizes very poorly outside the domain of the training data. At the same time, unsupervised systems have poor accuracy, and often do not generalize well, as they require the input document to belong to a larger corpus also given as input. Addressing these drawbacks, in this paper, we tackle keyphrase extraction from single documents with EmbedRank: a novel unsupervised method, that leverages sentence embeddings. EmbedRank achieves higher F-scores than graph-based state of the art systems on standard datasets and is suitable for real-time processing of large amounts of Web data. With EmbedRank, we also explicitly increase coverage and diversity among the selected keyphrases by introducing an embedding-based maximal marginal relevance (MMR) for new phrases. A user study including over 200 votes showed that, although reducing the phrases' semantic overlap leads to no gains in F-score, our high diversity selection is preferred by humans.