mlsanityData to 7 Oct 2026

HonestBait: Forward References for Attractive but Faithful Headline Generation

arXiv 2306.14828 ↗First posted 26 Jun 2023cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Current methods for generating attractive headlines often learn directly from data, which bases attractiveness on the number of user clicks and views. Although clicks or views do reflect user interest, they can fail to reveal how much interest is raised by the writing style and how much is due to the event or topic itself. Also, such approaches can lead to harmful inventions by over-exaggerating the content, aggravating the spread of false information. In this work, we propose HonestBait, a novel framework for solving these issues from another aspect: generating headlines using forward references (FRs), a writing technique often used for clickbait. A self-verification process is included during training to avoid spurious inventions. We begin with a preliminary user study to understand how FRs affect user interest, after which we present PANCO1, an innovative dataset containing pairs of fake news with verified news for attractive but faithful news headline generation. Automatic metrics and human evaluations show that our framework yields more attractive results (+11.25% compared to human-written verified news headlines) while maintaining high veracity, which helps promote real information to fight against fake news.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 23 of its 48 references that are in the map. First posted on arXiv 26 Jun 2023.

Builds on

23 of 48 references.

References · 23

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  5. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  6. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  7. 2015Sequence Level Training with Recurrent Neural Networkscited by 568
  8. 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
  9. 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 221
  10. 2018Stress Test Evaluation for Natural Language Inferencecited by 211
  11. 2019Learning Robust Representations by Projecting Superficial Statistics Outcited by 123
  12. 2019Fine-tune BERT for Extractive Summarizationcited by 122
11 more
  1. 2018BLEU is Not Suitable for the Evaluation of Text Simplificationcited by 78
  2. 2018A Survey on Natural Language Processing for Fake News Detectioncited by 67
  3. 2015LCSTS: A Large Scale Chinese Short Text Summarization Datasetcited by 65
  4. 2018Analogical Reasoning on Chinese Morphological and Semantic Relationscited by 50
  5. 2018No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytellingcited by 46
  6. 2020Hooks in the Headline: Learning to Generate Headlines with Controlled Stylescited by 46
  7. 2020Towards Robustifying NLI Models Against Lexical Dataset Biasescited by 34
  8. 2021ProphetNet-X: Large-Scale Pre-training Models for English, Chinese, Multi-lingual, Dialog, and Code Generationcited by 31
  9. 2020Improving Truthfulness of Headline Generationcited by 20
  10. 2019Clickbait? Sensational Headline Generation with Auto-tuned Reinforcement Learningcited by 19
  11. 2020Attractive or Faithful? Popularity-Reinforced Learning for Inspired Headline Generationcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 0; 2026: 1.

3 papers.