Applying a Generic Sequence-to-Sequence Model for Simple and Effective Keyphrase Generation
Not on the map. Why?
Abstract (arXiv)
In recent years, a number of keyphrase generation (KPG) approaches were proposed consisting of complex model architectures, dedicated training paradigms and decoding strategies. In this work, we opt for simplicity and show how a commonly used seq2seq language model, BART, can be easily adapted to generate keyphrases from the text in a single batch computation using a simple training procedure. Empirical results on five benchmarks show that our approach is as good as the existing state-of-the-art KPG systems, but using a much simpler and easy to deploy framework.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 21 of its 31 references that are in the map. First posted on arXiv 14 Jan 2022.
Builds on
21 of 31 references.
References · 21
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
- 2017Deep Keyphrase Generationcited by 102
- 2018One Size Does Not Fit All: Generating and Evaluating Variable Number of Keyphrasescited by 52
- 2021Text-to-Table: A New Way of Information Extractioncited by 47
- 2018Keyphrase Generation with Correlation Constraintscited by 45
- 2019Neural Keyphrase Generation via Reinforcement Learning with Adaptive Rewardscited by 41
- 2020Exclusive Hierarchical Decoding for Deep Keyphrase Generationcited by 38
- 2018Semi-Supervised Learning for Neural Keyphrase Generationcited by 36
- 2018Title-Guided Encoding for Keyphrase Generationcited by 36
9 more
- 2019An Integrated Approach for Keyphrase Generation via Exploring the Power of Retrieval and Extractioncited by 28
- 2020An Empirical Study on Neural Keyphrase Generationcited by 25
- 2021Robust Retrieval Augmented Generation for Zero-shot Slot Fillingcited by 24
- 2021Keyphrase Generation for Scientific Document Retrievalcited by 23
- 2021Intent Classification and Slot Filling for Privacy Policiescited by 18
- 2021Heterogeneous Graph Neural Networks for Keyphrase Generationcited by 15
- 2021Generative Relation Linking for Question Answering over Knowledge Basescited by 14
- 2021Keyphrase Generation with Fine-Grained Evaluation-Guided Reinforcement Learningcited by 13
- 2019Keyphrase Generation: A Text Summarization Strugglecited by 12
Built on by
Citing papers per year: 2022: 4; 2023: 4; 2024: 3; 2025: 1; 2026: 1.
13 papers.
Sort:
By area:
- 2023From Statistical Methods to Deep Learning, Automatic Keyphrase Prediction: A Surveycited by 14
- 2022Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Studycited by 13
- 2023Rethinking Model Selection and Decoding for Keyphrase Generation with Pre-trained Sequence-to-Sequence Modelscited by 8
- 2022Applying Transformer-based Text Summarization for Keyphrase Generationcited by 6
- 2022A Large-Scale Dataset for Biomedical Keyphrase Generationcited by 6
- 2024EUROPA: A Legal Multilingual Keyphrase Generation Datasetcited by 5
- 2024Pre-Trained Language Models for Keyphrase Prediction: A Reviewcited by 3
- 2024One2set + Large Language Model: Best Partners for Keyphrase Generationcited by 3
- 2022Detecting Generated Scientific Papers using an Ensemble of Transformer Modelscited by 1
- 2023Language Model as an Annotator: Unsupervised Context-aware Quality Phrase Generationcited by 1
- 2023Cross-Domain Robustness of Transformer-based Keyphrase Generationcited by 0
- 2025QExplorer: Large Language Model Based Query Extraction for Toxic Content Explorationcited by 0
1 more
- 2026Evaluating the Homogeneity of Keyphrase Prediction Models13 Feb 2026
- 2025QExplorer: Large Language Model Based Query Extraction for Toxic Content Exploration6 Feb 2025
- 2024One2set + Large Language Model: Best Partners for Keyphrase Generation4 Oct 2024
- 2024Pre-Trained Language Models for Keyphrase Prediction: A Review2 Sep 2024
- 2024EUROPA: A Legal Multilingual Keyphrase Generation Dataset1 Mar 2024
- 2023Language Model as an Annotator: Unsupervised Context-aware Quality Phrase Generation28 Dec 2023
- 2023Cross-Domain Robustness of Transformer-based Keyphrase Generation17 Dec 2023
- 2023Rethinking Model Selection and Decoding for Keyphrase Generation with Pre-trained Sequence-to-Sequence Models10 Oct 2023
- 2023From Statistical Methods to Deep Learning, Automatic Keyphrase Prediction: A Survey4 May 2023
- 2022Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study20 Dec 2022
- 2022A Large-Scale Dataset for Biomedical Keyphrase Generation22 Nov 2022
- 2022Detecting Generated Scientific Papers using an Ensemble of Transformer Models17 Sep 2022
1 more
- 2023From Statistical Methods to Deep Learning, Automatic Keyphrase Prediction: A Surveycited by 14
- 2022Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Studycited by 13
- 2022Applying Transformer-based Text Summarization for Keyphrase Generationcited by 6
- 2022A Large-Scale Dataset for Biomedical Keyphrase Generationcited by 6
- 2024EUROPA: A Legal Multilingual Keyphrase Generation Datasetcited by 5
- 2024Pre-Trained Language Models for Keyphrase Prediction: A Reviewcited by 3
- 2024One2set + Large Language Model: Best Partners for Keyphrase Generationcited by 3
- 2022Detecting Generated Scientific Papers using an Ensemble of Transformer Modelscited by 1
- 2023Language Model as an Annotator: Unsupervised Context-aware Quality Phrase Generationcited by 1
- 2023Cross-Domain Robustness of Transformer-based Keyphrase Generationcited by 0
- 2025QExplorer: Large Language Model Based Query Extraction for Toxic Content Explorationcited by 0
- 2026Evaluating the Homogeneity of Keyphrase Prediction Modelscited by 0
- 2026Evaluating the Homogeneity of Keyphrase Prediction Models13 Feb 2026
- 2025QExplorer: Large Language Model Based Query Extraction for Toxic Content Exploration6 Feb 2025
- 2024One2set + Large Language Model: Best Partners for Keyphrase Generation4 Oct 2024
- 2024Pre-Trained Language Models for Keyphrase Prediction: A Review2 Sep 2024
- 2024EUROPA: A Legal Multilingual Keyphrase Generation Dataset1 Mar 2024
- 2023Language Model as an Annotator: Unsupervised Context-aware Quality Phrase Generation28 Dec 2023
- 2023Cross-Domain Robustness of Transformer-based Keyphrase Generation17 Dec 2023
- 2023From Statistical Methods to Deep Learning, Automatic Keyphrase Prediction: A Survey4 May 2023
- 2022Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study20 Dec 2022
- 2022A Large-Scale Dataset for Biomedical Keyphrase Generation22 Nov 2022
- 2022Detecting Generated Scientific Papers using an Ensemble of Transformer Models17 Sep 2022
- 2022Applying Transformer-based Text Summarization for Keyphrase Generation8 Sep 2022