# Does Order Matter? An Empirical Study on Generating Multiple Keyphrases as a Sequence

arXiv: https://arxiv.org/abs/1909.03590 · HTML: https://mlsanity.com/paper/1909.03590/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 9 Sep 2019.

## Built on by (most cited first, 8 of 8)

- [One2Set: Generating Diverse Keyphrases as a Set](https://mlsanity.com/paper/2105.11134/) (2021)
- [UniKeyphrase: A Unified Extraction and Generation Framework for Keyphrase Prediction](https://mlsanity.com/paper/2106.04847/) (2021)
- [From Statistical Methods to Deep Learning, Automatic Keyphrase Prediction: A Survey](https://mlsanity.com/paper/2305.02579/) (2023)
- [Unsupervised Deep Keyphrase Generation](https://mlsanity.com/paper/2104.08729/) (2021)
- [Conditional set generation using Seq2seq models](https://mlsanity.com/paper/2205.12485/) (2022)
- [Applying Transformer-based Text Summarization for Keyphrase Generation](https://mlsanity.com/paper/2209.03791/) (2022)
- [EUROPA: A Legal Multilingual Keyphrase Generation Dataset](https://mlsanity.com/paper/2403.00252/) (2024)
- [Neural Keyphrase Generation: Analysis and Evaluation](https://mlsanity.com/paper/2304.13883/) (2023)

## Abstract (arXiv)

Recently, concatenating multiple keyphrases as a target sequence has been proposed as a new learning paradigm for keyphrase generation. Existing studies concatenate target keyphrases in different orders but no study has examined the effects of ordering on models' behavior. In this paper, we propose several orderings for concatenation and inspect the important factors for training a successful keyphrase generation model. By running comprehensive comparisons, we observe one preferable ordering and summarize a number of empirical findings and challenges, which can shed light on future research on this line of work.