Toward Improving Coherence and Diversity of Slogan Generation
Not on the map. Why?
Abstract (arXiv)
Previous work in slogan generation focused on utilising slogan skeletons mined from existing slogans. While some generated slogans can be catchy, they are often not coherent with the company's focus or style across their marketing communications because the skeletons are mined from other companies' slogans. We propose a sequence-to-sequence (seq2seq) transformer model to generate slogans from a brief company description. A naive seq2seq model fine-tuned for slogan generation is prone to introducing false information. We use company name delexicalisation and entity masking to alleviate this problem and improve the generated slogans' quality and truthfulness. Furthermore, we apply conditional training based on the first words' POS tag to generate syntactically diverse slogans. Our best model achieved a ROUGE-1/-2/-L F1 score of 35.58/18.47/33.32. Besides, automatic and human evaluations indicate that our method generates significantly more factual, diverse and catchy slogans than strong LSTM and transformer seq2seq baselines.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 86 references that are in the map. First posted on arXiv 11 Feb 2021.
Builds on
41 of 86 references.
References · 41
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
- 2018Hierarchical Neural Story Generationcited by 1,193
29 more
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2015Teaching Machines to Read and Comprehendcited by 1,049
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
- 2020A Primer in BERTology: What we know about how BERT workscited by 815
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
- 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
- 2019Neural Text Generation with Unlikelihood Trainingcited by 503
- 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 431
- 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 378
- 2020FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarizationcited by 293
- 2020fastai: A Layered API for Deep Learningcited by 183
- 2017Faithful to the Original: Fact Aware Neural Abstractive Summarizationcited by 141
- 2020Factual Error Correction for Abstractive Summarization Modelscited by 108
- 2019Assessing The Factual Accuracy of Generated Textcited by 103
- 2018Language GANs Falling Shortcited by 97
- 2019Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reportscited by 96
- 2019Answers Unite! Unsupervised Metrics for Reinforced Summarization Modelscited by 92
- 2020GO FIGURE: A Meta Evaluation of Factuality in Summarizationcited by 76
- 2020Multi-Fact Correction in Abstractive Text Summarizationcited by 66
- 2019Question Answering as an Automatic Evaluation Metric for News Article Summarizationcited by 63
- 2016A Simple, Fast Diverse Decoding Algorithm for Neural Generationcited by 58
- 2020Hooks in the Headline: Learning to Generate Headlines with Controlled Stylescited by 46
- 2020Learning to Create Better Ads: Generation and Ranking Approaches for Ad Creative Refinementcited by 29
- 2020Improving Truthfulness of Headline Generationcited by 20
- 2019Enabling Hyper-Personalisation: Automated Ad Creative Generation and Ranking for Fashion e-Commercecited by 8
- 2018Bi-Directional Differentiable Input Reconstruction for Low-Resource Neural Machine Translationcited by 4
Built on by
Citing papers per year: 2023: 1.
1 paper.
- 2023Natural Language Generation for Advertising: A Surveycited by 10
- 2023Natural Language Generation for Advertising: A Survey22 Jun 2023