Context-aware and Style-related Incremental Decoding framework for Discourse-Level Literary Translation
Not on the map. Why?
Abstract (arXiv)
This report outlines our approach for the WMT24 Discourse-Level Literary Translation Task, focusing on the Chinese-English language pair in the Constrained Track. Translating literary texts poses significant challenges due to the nuanced meanings, idiomatic expressions, and intricate narrative structures inherent in such works. To address these challenges, we leveraged the Chinese-Llama2 model, specifically enhanced for this task through a combination of Continual Pre-training (CPT) and Supervised Fine-Tuning (SFT). Our methodology includes a novel Incremental Decoding framework, which ensures that each sentence is translated with consideration of its broader context, maintaining coherence and consistency throughout the text. This approach allows the model to capture long-range dependencies and stylistic elements, producing translations that faithfully preserve the original literary quality. Our experiments demonstrate significant improvements in both sentence-level and document-level BLEU scores, underscoring the effectiveness of our proposed framework in addressing the complexities of document-level literary translation.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 13 of its 21 references that are in the map. First posted on arXiv 25 Sep 2024.
Builds on
13 of 21 references.
References · 13
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
- 2017Non-Autoregressive Neural Machine Translationcited by 457
- 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 302
- 2023BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languagescited by 60
- 2023TIM: Teaching Large Language Models to Translate with Comparisoncited by 50
- 2023Improving Translation Faithfulness of Large Language Models via Augmenting Instructionscited by 28
- 2021Self-Distillation Mixup Training for Non-autoregressive Neural Machine Translationcited by 8
1 more
Built on by
Citing papers per year: 2024: 1; 2025: 4.
5 papers.
- 2024Findings of the WMT 2024 Shared Task on Discourse-Level Literary Translationcited by 15
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translationcited by 8
- 2025Source-primed Multi-turn Conversation Helps Large Language Models Translate Documentscited by 7
- 2025Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Modelscited by 0
- 2025Unlocking Latent Discourse Translation in LLMs Through Quality-Aware Decodingcited by 0
- 2025Unlocking Latent Discourse Translation in LLMs Through Quality-Aware Decoding8 Oct 2025
- 2025Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Models9 Jun 2025
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation2 Apr 2025
- 2025Source-primed Multi-turn Conversation Helps Large Language Models Translate Documents13 Mar 2025
- 2024Findings of the WMT 2024 Shared Task on Discourse-Level Literary Translation16 Dec 2024