mlsanityData to 7 Oct 2026

Towards Chapter-to-Chapter Context-Aware Literary Translation via Large Language Models

arXiv 2407.08978 ↗First posted 12 Jul 2024cs.CL cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Discourse phenomena in existing document-level translation datasets are sparse, which has been a fundamental obstacle in the development of context-aware machine translation models. Moreover, most existing document-level corpora and context-aware machine translation methods rely on an unrealistic assumption on sentence-level alignments. To mitigate these issues, we first curate a novel dataset of Chinese-English literature, which consists of 160 books with intricate discourse structures. Then, we propose a more pragmatic and challenging setting for context-aware translation, termed chapter-to-chapter (Ch2Ch) translation, and investigate the performance of commonly-used machine translation models under this setting. Furthermore, we introduce a potential approach of finetuning large language models (LLMs) within the domain of Ch2Ch literary translation, yielding impressive improvements over baselines. Through our comprehensive analysis, we unveil that literary translation under the Ch2Ch setting is challenging in nature, with respect to both model learning methods and translation decoding algorithms.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 12 Jul 2024.

Builds on

26 of 37 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  6. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  7. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  8. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 344
  9. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 172
  10. 2022Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generationcited by 90
  11. 2023A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Modelscited by 88
  12. 2023Large language models effectively leverage document-level context for literary translation, but critical errors persistcited by 80
14 more
  1. 2018Improving the Transformer Translation Model with Document-Level Contextcited by 74
  2. 2023BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languagescited by 60
  3. 2023Eliciting the Translation Ability of Large Language Models via Multilingual Finetuning with Translation Instructionscited by 55
  4. 2021Measuring and Increasing Context Usage in Context-Aware Machine Translationcited by 48
  5. 2022Exploring Document-Level Literary Machine Translation with Parallel Paragraphs from World Literaturecited by 45
  6. 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decodercited by 44
  7. 2023BayLing: Bridging Cross-lingual Alignment and Instruction Following through Interactive Translation for Large Language Modelscited by 42
  8. 2020Rethinking Document-level Neural Machine Translationcited by 32
  9. 2023ChatGPT MT: Competitive for High- (but not Low-) Resource Languagescited by 23
  10. 2021Divide and Rule: Effective Pre-Training for Context-Aware Multi-Encoder Translation Modelscited by 12
  11. 2023Look-back Decoding for Open-Ended Text Generationcited by 10
  12. 2023Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Levelcited by 9
  13. 2023Challenges in Context-Aware Neural Machine Translationcited by 5
  14. 2023Exploring Paracrawl for Document-level Neural Machine Translationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.