mlsanityData to 7 Oct 2026

Exploring Automatic Text Simplification of German Narrative Documents

arXiv 2312.09907 ↗First posted 15 Dec 2023cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper, we apply transformer-based Natural Language Generation (NLG) techniques to the problem of text simplification. Currently, there are only a few German datasets available for text simplification, even fewer with larger and aligned documents, and not a single one with narrative texts. In this paper, we explore to which degree modern NLG techniques can be applied to German narrative text simplifications. We use Longformer attention and a pre-trained mBART model. Our findings indicate that the existing approaches for German are not able to solve the task properly. We conclude on a few directions for future research to address this problem.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 39 references that are in the map. First posted on arXiv 15 Dec 2023.

Builds on

18 of 39 references.

References · 18

  1. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  6. 2018Hierarchical Neural Story Generationcited by 1,182
  7. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  8. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
  9. 2019Neural Text Generation with Unlikelihood Trainingcited by 489
  10. 2020Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgettingcited by 169
  11. 2020Anatomy of Catastrophic Forgetting: Hidden Representations and Task Semanticscited by 158
  12. 2022Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generationcited by 90
6 more
  1. 2022Contrastive Search Is What You Need For Neural Text Generationcited by 58
  2. 2021AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarizationcited by 51
  3. 2021Straight to the Gradient: Learning to Use Novel Tokens for Neural Text Generationcited by 19
  4. 2019A Corpus for Automatic Readability Assessment and Text Simplification of Germancited by 18
  5. 2023Language Models for German Text Simplification: Overcoming Parallel Data Scarcity through Style-specific Pre-trainingcited by 15
  6. 2023DEPLAIN: A German Parallel Corpus with Intralingual Translations into Plain Language for Sentence and Document Simplificationcited by 14

Built on by

Not cited yet.