PatternRank: Leveraging Pretrained Language Models and Part of Speech for Unsupervised Keyphrase Extraction
Not on the map. Why?
Abstract (arXiv)
Keyphrase extraction is the process of automatically selecting a small set of most relevant phrases from a given text. Supervised keyphrase extraction approaches need large amounts of labeled training data and perform poorly outside the domain of the training data. In this paper, we present PatternRank, which leverages pretrained language models and part-of-speech for unsupervised keyphrase extraction from single documents. Our experiments show PatternRank achieves higher precision, recall and F1-scores than previous state-of-the-art approaches. In addition, we present the KeyphraseVectorizers package, which allows easy modification of part-of-speech patterns for candidate keyphrase selection, and hence adaptation of our approach to any domain.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 8 of its 29 references that are in the map. First posted on arXiv 11 Oct 2022.
Builds on
8 of 29 references.
References · 8
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2014Distributed Representations of Sentences and Documentscited by 678
- 2017Unsupervised Learning of Sentence Embeddings using Compositional n-Gram Featurescited by 104
- 2017SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publicationscited by 102
- 2017Deep Keyphrase Generationcited by 102
- 2018Simple Unsupervised Keyphrase Extraction using Sentence Embeddingscited by 62
- 2019A Review of Keyphrase Extractioncited by 33
Built on by
Citing papers per year: 2022: 1; 2023: 9; 2024: 5; 2025: 3; 2026: 1.
19 papers.
Sort:
By area:
- 2022Evaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approachescited by 39
- 2023A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depressioncited by 8
- 2023Exploring the Landscape of Natural Language Processing Researchcited by 7
- 2023Efficient Domain Adaptation of Sentence Embeddings Using Adapterscited by 6
- 2023AspectCSE: Sentence Embeddings for Aspect-based Semantic Textual Similarity Using Contrastive Learning and Structured Knowledgecited by 5
- 2025GraphiT: Efficient Node Classification on Text-Attributed Graphs with Prompt Optimized LLMscited by 4
- 2023Theme-driven Keyphrase Extraction to Analyze Social Media Discoursecited by 3
- 2024Automated Question Generation for Science Tests in Arabic Language Using NLP Techniquescited by 3
- 2024Pre-Trained Language Models for Keyphrase Prediction: A Reviewcited by 3
- 2023EntropyRank: Unsupervised Keyphrase Extraction via Side-Information Optimization for Language Model-based Text Compressioncited by 2
- 2024An Improved Method for Class-specific Keyword Extraction: A Case Study in the German Business Registrycited by 2
- 2024LongKey: Keyphrase Extraction for Long Documentscited by 1
7 more
- 2023Applying unsupervised keyphrase methods on concepts extracted from discharge sheetscited by 0
- 2023Unsupervised extraction of local and global keywords from a single textcited by 0
- 2023Brand Network Booster: A new system for improving brand connectivitycited by 0
- 2024Enterprise Use Cases Combining Knowledge Graphs and Natural Language Processingcited by 0
- 2025Dynamik: Syntactically-Driven Dynamic Font Sizing for Emphasis of Key Informationcited by 0
- 2025SPAR: Session-based Pipeline for Adaptive Retrieval on Legacy File Systemscited by 0
- 2026Attention Expansion: Enhancing Keyphrase Extraction from Long Documents with Attention-Augmented Contextualized Embeddingscited by 0
- 2026Attention Expansion: Enhancing Keyphrase Extraction from Long Documents with Attention-Augmented Contextualized Embeddings9 Jun 2026
- 2025SPAR: Session-based Pipeline for Adaptive Retrieval on Legacy File Systems15 Dec 2025
- 2025Dynamik: Syntactically-Driven Dynamic Font Sizing for Emphasis of Key Information13 Apr 2025
- 2025GraphiT: Efficient Node Classification on Text-Attributed Graphs with Prompt Optimized LLMs14 Feb 2025
- 2024LongKey: Keyphrase Extraction for Long Documents26 Nov 2024
- 2024Pre-Trained Language Models for Keyphrase Prediction: A Review2 Sep 2024
- 2024An Improved Method for Class-specific Keyword Extraction: A Case Study in the German Business Registry19 Jul 2024
- 2024Automated Question Generation for Science Tests in Arabic Language Using NLP Techniques11 Jun 2024
- 2024Enterprise Use Cases Combining Knowledge Graphs and Natural Language Processing1 Apr 2024
- 2023A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depression23 Nov 2023
- 2023Brand Network Booster: A new system for improving brand connectivity28 Sep 2023
- 2023EntropyRank: Unsupervised Keyphrase Extraction via Side-Information Optimization for Language Model-based Text Compression25 Aug 2023
7 more
- 2023Unsupervised extraction of local and global keywords from a single text26 Jul 2023
- 2023Exploring the Landscape of Natural Language Processing Research20 Jul 2023
- 2023AspectCSE: Sentence Embeddings for Aspect-based Semantic Textual Similarity Using Contrastive Learning and Structured Knowledge15 Jul 2023
- 2023Efficient Domain Adaptation of Sentence Embeddings Using Adapters6 Jul 2023
- 2023Applying unsupervised keyphrase methods on concepts extracted from discharge sheets15 Mar 2023
- 2023Theme-driven Keyphrase Extraction to Analyze Social Media Discourse27 Jan 2023
- 2022Evaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approaches29 Nov 2022
- 2022Evaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approachescited by 39
- 2023A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depressioncited by 8
- 2023Exploring the Landscape of Natural Language Processing Researchcited by 7
- 2023Efficient Domain Adaptation of Sentence Embeddings Using Adapterscited by 6
- 2023AspectCSE: Sentence Embeddings for Aspect-based Semantic Textual Similarity Using Contrastive Learning and Structured Knowledgecited by 5
- 2025GraphiT: Efficient Node Classification on Text-Attributed Graphs with Prompt Optimized LLMscited by 4
- 2023Theme-driven Keyphrase Extraction to Analyze Social Media Discoursecited by 3
- 2024Automated Question Generation for Science Tests in Arabic Language Using NLP Techniquescited by 3
- 2024Pre-Trained Language Models for Keyphrase Prediction: A Reviewcited by 3
- 2023EntropyRank: Unsupervised Keyphrase Extraction via Side-Information Optimization for Language Model-based Text Compressioncited by 2
- 2024An Improved Method for Class-specific Keyword Extraction: A Case Study in the German Business Registrycited by 2
- 2024LongKey: Keyphrase Extraction for Long Documentscited by 1
12 most cited of 18 All 18 (JSON)
- 2026Attention Expansion: Enhancing Keyphrase Extraction from Long Documents with Attention-Augmented Contextualized Embeddings9 Jun 2026
- 2025Dynamik: Syntactically-Driven Dynamic Font Sizing for Emphasis of Key Information13 Apr 2025
- 2025GraphiT: Efficient Node Classification on Text-Attributed Graphs with Prompt Optimized LLMs14 Feb 2025
- 2024LongKey: Keyphrase Extraction for Long Documents26 Nov 2024
- 2024Pre-Trained Language Models for Keyphrase Prediction: A Review2 Sep 2024
- 2024An Improved Method for Class-specific Keyword Extraction: A Case Study in the German Business Registry19 Jul 2024
- 2024Automated Question Generation for Science Tests in Arabic Language Using NLP Techniques11 Jun 2024
- 2024Enterprise Use Cases Combining Knowledge Graphs and Natural Language Processing1 Apr 2024
- 2023A Cross Attention Approach to Diagnostic Explainability using Clinical Practice Guidelines for Depression23 Nov 2023
- 2023Brand Network Booster: A new system for improving brand connectivity28 Sep 2023
- 2023EntropyRank: Unsupervised Keyphrase Extraction via Side-Information Optimization for Language Model-based Text Compression25 Aug 2023
- 2023Unsupervised extraction of local and global keywords from a single text26 Jul 2023
12 newest of 18 All 18 (JSON)