mlsanityData to 14 Oct 2026

Toward Improving Coherence and Diversity of Slogan Generation

arXiv 2102.05924 ↗First posted 11 Feb 2021cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Previous work in slogan generation focused on utilising slogan skeletons mined from existing slogans. While some generated slogans can be catchy, they are often not coherent with the company's focus or style across their marketing communications because the skeletons are mined from other companies' slogans. We propose a sequence-to-sequence (seq2seq) transformer model to generate slogans from a brief company description. A naive seq2seq model fine-tuned for slogan generation is prone to introducing false information. We use company name delexicalisation and entity masking to alleviate this problem and improve the generated slogans' quality and truthfulness. Furthermore, we apply conditional training based on the first words' POS tag to generate syntactically diverse slogans. Our best model achieved a ROUGE-1/-2/-L F1 score of 35.58/18.47/33.32. Besides, automatic and human evaluations indicate that our method generates significantly more factual, diverse and catchy slogans than strong LSTM and transformer seq2seq baselines.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 41 of its 86 references that are in the map. First posted on arXiv 11 Feb 2021.

Builds on

41 of 86 references.

References · 41

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  6. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  7. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  8. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  9. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  10. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  11. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  12. 2018Hierarchical Neural Story Generationcited by 1,193
29 more
  1. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,102
  2. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  3. 2015Teaching Machines to Read and Comprehendcited by 1,049
  4. 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,026
  5. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
  6. 2020A Primer in BERTology: What we know about how BERT workscited by 815
  7. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
  8. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 723
  9. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
  10. 2019Neural Text Generation with Unlikelihood Trainingcited by 503
  11. 2018Bag of Tricks for Image Classification with Convolutional Neural Networkscited by 431
  12. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 378
  13. 2020FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarizationcited by 293
  14. 2020fastai: A Layered API for Deep Learningcited by 183
  15. 2017Faithful to the Original: Fact Aware Neural Abstractive Summarizationcited by 141
  16. 2020Factual Error Correction for Abstractive Summarization Modelscited by 108
  17. 2019Assessing The Factual Accuracy of Generated Textcited by 103
  18. 2018Language GANs Falling Shortcited by 97
  19. 2019Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reportscited by 96
  20. 2019Answers Unite! Unsupervised Metrics for Reinforced Summarization Modelscited by 92
  21. 2020GO FIGURE: A Meta Evaluation of Factuality in Summarizationcited by 76
  22. 2020Multi-Fact Correction in Abstractive Text Summarizationcited by 66
  23. 2019Question Answering as an Automatic Evaluation Metric for News Article Summarizationcited by 63
  24. 2016A Simple, Fast Diverse Decoding Algorithm for Neural Generationcited by 58
  25. 2020Hooks in the Headline: Learning to Generate Headlines with Controlled Stylescited by 46
  26. 2020Learning to Create Better Ads: Generation and Ranking Approaches for Ad Creative Refinementcited by 29
  27. 2020Improving Truthfulness of Headline Generationcited by 20
  28. 2019Enabling Hyper-Personalisation: Automated Ad Creative Generation and Ranking for Fashion e-Commercecited by 8
  29. 2018Bi-Directional Differentiable Input Reconstruction for Low-Resource Neural Machine Translationcited by 4

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.