mlsanityData to 7 Oct 2026

Self-Attentive Model for Headline Generation

arXiv 1901.07786 ↗First posted 23 Jan 2019cs.CL cs.AIcited by 16

Not on the map. Why?

Abstract (arXiv)

Headline generation is a special type of text summarization task. While the amount of available training data for this task is almost unlimited, it still remains challenging, as learning to generate headlines for news articles implies that the model has strong reasoning about natural language. To overcome this issue, we applied recent Universal Transformer architecture paired with byte-pair encoding technique and achieved new state-of-the-art results on the New York Times Annotated corpus with ROUGE-L F1-score 24.84 and ROUGE-2 F1-score 13.48. We also present the new RIA corpus and reach ROUGE-L F1-score 36.81 and ROUGE-2 F1-score 22.15 on it.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jan 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 1; 2023: 5; 2024: 2; 2025: 5; 2026: 1.

16 papers.

Sort:

  1. 2024The Russian-focused embedders' exploration: ruMTEB benchmark and Russian embedding model designcited by 20
  2. 2021NewsBERT: Distilling Pre-trained Language Model for Intelligent News Applicationcited by 17
  3. 2023"Why is this misleading?": Detecting News Headline Hallucinations with Explanationscited by 17
  4. 2023Harnessing the Power of LLMs: Evaluating Human-AI Text Co-Creation through the Lens of News Headline Generationcited by 14
  5. 2021Fine-tuning GPT-3 for Russian Text Summarizationcited by 12
  6. 2023Large Scale Multi-Lingual Multi-Modal Summarization Datasetcited by 12
  7. 2023Follow the Timeline! Generating Abstractive and Extractive Timeline Summary in Chronological Ordercited by 6
  8. 2022Contrastive Learning enhanced Author-Style Headline Generationcited by 2
  9. 2023Let AI Entertain You: Increasing User Engagement with Generative AI and Rejection Samplingcited by 2
  10. 2025Fact-Preserved Personalized News Headline Generationcited by 2
  11. 2025Building Russian Benchmark for Evaluation of Information Retrieval Modelscited by 2
  12. 2025BeliN: A Novel Corpus for Bengali Religious News Headline Generation using Contextual Feature Fusioncited by 1
4 more
  1. 2025Introducing Spotlight: A Novel Approach for Generating Captivating Key Information from Documentscited by 1
  2. 2026COBART: Controlled, Optimized, Bidirectional and Auto-Regressive Transformer for Ad Headline Generationcited by 1
  3. 2024Improving Sequence-to-Sequence Models for Abstractive Text Summarization Using Meta Heuristic Approachescited by 0
  4. 2025KoWit-24: A Richly Annotated Dataset of Wordplay in News Headlinescited by 0