mlsanityData to 7 Oct 2026

Context-aware and Style-related Incremental Decoding framework for Discourse-Level Literary Translation

arXiv 2409.16539 ↗First posted 25 Sep 2024cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

This report outlines our approach for the WMT24 Discourse-Level Literary Translation Task, focusing on the Chinese-English language pair in the Constrained Track. Translating literary texts poses significant challenges due to the nuanced meanings, idiomatic expressions, and intricate narrative structures inherent in such works. To address these challenges, we leveraged the Chinese-Llama2 model, specifically enhanced for this task through a combination of Continual Pre-training (CPT) and Supervised Fine-Tuning (SFT). Our methodology includes a novel Incremental Decoding framework, which ensures that each sentence is translated with consideration of its broader context, maintaining coherence and consistency throughout the text. This approach allows the model to capture long-range dependencies and stylistic elements, producing translations that faithfully preserve the original literary quality. Our experiments demonstrate significant improvements in both sentence-level and document-level BLEU scores, underscoring the effectiveness of our proposed framework in addressing the complexities of document-level literary translation.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 13 of its 21 references that are in the map. First posted on arXiv 25 Sep 2024.

Builds on

13 of 21 references.

References · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  6. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  7. 2017Non-Autoregressive Neural Machine Translationcited by 457
  8. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 302
  9. 2023BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languagescited by 60
  10. 2023TIM: Teaching Large Language Models to Translate with Comparisoncited by 50
  11. 2023Improving Translation Faithfulness of Large Language Models via Augmenting Instructionscited by 28
  12. 2021Self-Distillation Mixup Training for Non-autoregressive Neural Machine Translationcited by 8
1 more
  1. 2021Joint-training on Symbiosis Networks for Deep Nueral Machine Translation modelscited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 4.

5 papers.