mlsanityData to 7 Oct 2026

Automatic Generation of Factual News Headlines in Finnish

arXiv 2212.02170 ↗First posted 5 Dec 2022cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

We present a novel approach to generating news headlines in Finnish for a given news story. We model this as a summarization task where a model is given a news article, and its task is to produce a concise headline describing the main topic of the article. Because there are no openly available GPT-2 models for Finnish, we will first build such a model using several corpora. The model is then fine-tuned for the headline generation task using a massive news corpus. The system is evaluated by 3 expert journalists working in a Finnish media house. The results showcase the usability of the presented approach as a headline suggestion tool to facilitate the news production process.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 33 references that are in the map. First posted on arXiv 5 Dec 2022.

Builds on

18 of 33 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2017Decoupled Weight Decay Regularizationcited by 1,722
  6. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  7. 2019Text Summarization with Pretrained Encoderscited by 553
  8. 2016Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Modelscited by 299
  9. 2020A Theoretical Analysis of the Repetition Problem in Text Generationcited by 83
  10. 2020Automatic Text Summarization of COVID-19 Medical Research Articles using BERT and GPT-2cited by 23
  11. 2020Improving Truthfulness of Headline Generationcited by 20
  12. 2021Human Evaluation of Creative NLG Systems: An Interdisciplinary Survey on Recent Paperscited by 18
6 more
  1. 2019Controlling the Amount of Verbatim Copying in Abstractive Summarizationcited by 17
  2. 2020Advances of Transformer-Based Models for News Headline Generationcited by 10
  3. 2019Template-free Data-to-Text Generation of Finnish Sports Newscited by 9
  4. 2021The Great Misalignment Problem in Human Evaluation of NLP Methodscited by 8
  5. 2021Never guess what I heard... Rumor Detection in Finnish News: a Dataset and a Baselinecited by 4
  6. 2017Low-Resource Neural Headline Generationcited by 2

Built on by

Cited by year

Citing papers per year: 2022: 1.

1 paper.

  1. 2022Emotion Conditioned Creative Dialog Generationcited by 1