Doc2FRC: Length-Consistent Document-Level Machine Translation via Fixed-Range Chunking
Not on the map. Why?
Abstract (arXiv)
Advanced large language models (LLMs) with long context windows can substantially reduce input truncation in document-level machine translation (DocMT). However, direct Doc2Doc translation remains prone to n-gram repetition and progressive quality degradation. A common remedy is to segment the document into finer-grained chunks. Nonetheless, conventional rule-based chunking approaches fail to handle the length distribution mismatch between training and inference. To address this, we introduce Fixed-Range Chunking (FRC), utilizing dynamic programming to partition documents into chunks within a predefined length interval. By consistently applying FRC during training and inference, the input documents of any length are mapped to the same length distribution, substantially reducing train-test length mismatch. Centered on FRC, we propose a lightweight dual-boundary matching algorithm for chunk alignment, alongside four distinct training strategies. Experimental results show that FRC-based fine-tuning substantially improves 7B LLMs over direct Doc2Doc fine-tuning and outperforms existing DocMT methods on IWSLT2017. We further construct GlobVDoc, a 10-language test set independent of mainstream DocMT training sources, and show that FRC improves out-of-distribution document translation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 186 references that are in the map. First posted on arXiv 11 Sep 2026.
Builds on
50 of 186 references.
References · 50
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
- 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
- 2020Language-agnostic BERT Sentence Embeddingcited by 621
- 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 416
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 344
- 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 205
- 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 143
38 more
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 138
- 2023Randomized Positional Encodings Boost Length Generalization of Transformerscited by 114
- 2022Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generationcited by 106
- 2018Context-Aware Neural Machine Translation Learns Anaphora Resolutioncited by 97
- 2023Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Taskcited by 88
- 2018Document-Level Neural Machine Translation with Hierarchical Attention Networkscited by 85
- 2023Large language models effectively leverage document-level context for literary translation, but critical errors persistcited by 80
- 2024Adapting Large Language Models for Document-Level Machine Translationcited by 59
- 2021BlonDe: An Automatic Evaluation Metric for Document-level Machine Translationcited by 58
- 2022Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric Into a Document-Level Metriccited by 56
- 2024(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary Textscited by 49
- 2019When and Why is Document-level Context Useful in Neural Machine Translation?cited by 45
- 2017Document Context Neural Machine Translation with Memory Networkscited by 41
- 2021SHAPE: Shifted Absolute Position Embedding for Transformerscited by 37
- 2021Sequence Length is a Domain: Length-based Overfitting in Transformer Modelscited by 34
- 2024DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memorycited by 27
- 2023Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMscited by 25
- 2024Repetition Neurons: How Do Language Models Produce Repetitions?cited by 22
- 2018Beyond Error Propagation in Neural Machine Translation: Characteristics of Language Also Mattercited by 18
- 2024Meta-Chunking: Learning Text Segmentation and Semantic Completion via Logical Perceptioncited by 17
- 2024Findings of the WMT 2024 Shared Task on Discourse-Level Literary Translationcited by 15
- 2023SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Windowcited by 11
- 2025AFRIDOC-MT: Document-level MT Corpus for African Languagescited by 11
- 2025Multilingual Contextualization of Large Language Models for Document-Level Machine Translationcited by 11
- 2024Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Datacited by 10
- 2024Investigating Length Issues in Document-level Machine Translationcited by 10
- 2023Autocorrelations Decay in Texts and Applicability Limits of Language Modelscited by 7
- 2025Source-primed Multi-turn Conversation Helps Large Language Models Translate Documentscited by 7
- 2025DocHPLT: A Massively Multilingual Document-Level Translation Datasetcited by 7
- 2024Recovering document annotations for sentence-level bitextcited by 6
- 2025Doc-Guided Sent2Sent++: A Sent2Sent++ Agent with Doc-Guided memory for Document-level Machine Translationcited by 6
- 2025Hallucinate at the Last in Long Response Generation: A Case Study on Long Document Summarizationcited by 6
- 2024How Effective are State Space Models for Machine Translation?cited by 5
- 2025Improving LLM-based Document-level Machine Translation with Multi-Knowledge Fusioncited by 2
- 2025GRAFT: A Graph-based Flow-aware Agentic Framework for Document-level Machine Translationcited by 2
- 2025BiMax: Bidirectional MaxSim Score for Document-Level Alignmentcited by 2
- 2026Cross-Preference Learning for Sentence-Level and Context-Aware Machine Translationcited by 2
- 2025Quality Estimation Reranking for Document-Level Translationcited by 1
Built on by
Not cited yet.