Cross-Preference Learning for Sentence-Level and Context-Aware Machine Translation
Not on the map. Why?
Abstract (arXiv)
Context-aware machine translation (MT) leverages document-level information, yet it does not consistently outperform sentence-level MT, as contextual signals are unevenly beneficial across sentences. Existing training objectives do not explicitly model this variability, limiting a model's ability to adaptively exploit context. In this paper, we propose Cross-Preference Learning (CPL), a preference-based training framework that explicitly captures the complementary benefits of sentence-level and context-aware MT. CPL achieves this by integrating both intra- and cross-condition preferences into the preference optimization objective, providing explicit supervision to exploit informative context while remaining robust to uninformative context. We validate the proposed approach on several public context-aware MT tasks using multiple models, including Qwen3-4B, Qwen3-8B, and Llama-3-8B-Instruct. Experimental results demonstrate consistent improvements in translation quality and robustness across both input conditions, achieved without any architectural modifications.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 33 of its 43 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
33 of 43 references.
References · 33
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2017Deep reinforcement learning from human preferencescited by 3,912
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
- 2022Contrastive Decoding: Open-ended Text Generation as Optimizationcited by 609
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
- 2018Context-Aware Neural Machine Translation Learns Anaphora Resolutioncited by 97
- 2017Neural Machine Translation with Extended Contextcited by 95
- 2023Large language models effectively leverage document-level context for literary translation, but critical errors persistcited by 80
21 more
- 2024Adapting Large Language Models for Document-Level Machine Translationcited by 59
- 2021BlonDe: An Automatic Evaluation Metric for Document-level Machine Translationcited by 58
- 2022Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric Into a Document-Level Metriccited by 56
- 2022Towards Opening the Black Box of Neural Machine Translation: Source and Target Interpretations of the Transformercited by 45
- 2023Direct Preference Optimization for Neural Machine Translation with Minimum Bayes Risk Decodingcited by 28
- 2024DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memorycited by 27
- 2024Efficiently Exploring Large Language Models for Document-Level Machine Translation with In-context Learningcited by 23
- 2024The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilitiescited by 22
- 2024Word Alignment as Preference for Machine Translationcited by 14
- 2024Enhancing Document-level Translation of Large Language Model via Translation Mixed-instructionscited by 13
- 2025Multilingual Contextualization of Large Language Models for Document-Level Machine Translationcited by 11
- 2024Fine-Grained and Multi-Dimensional Metrics for Document-Level Machine Translationcited by 10
- 2024Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translationcited by 8
- 2025Source-primed Multi-turn Conversation Helps Large Language Models Translate Documentscited by 7
- 2024DeMPT: Decoding-enhanced Multi-phase Prompt Tuning for Making LLMs Be Better Context-aware Translatorscited by 6
- 2024Context-Aware or Context-Insensitive? Assessing LLMs' Performance in Document-Level Translationcited by 6
- 2025Doc-Guided Sent2Sent++: A Sent2Sent++ Agent with Doc-Guided memory for Document-level Machine Translationcited by 6
- 2024Cross-lingual Human-Preference Alignment for Neural Machine Translation with Direct Quality Optimizationcited by 5
- 2025Two Intermediate Translations Are Better Than One: Fine-tuning LLMs for Document-level Translation Refinementcited by 5
- 2025M2PO: Multi-Perspective Multi-Pair Preference Optimization for Machine Translationcited by 4
- 2025CRPO: Confidence-Reward Driven Preference Optimization for Machine Translationcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation
- 2026CLewR: Curriculum Learning with Restarts for Machine Translation Preference Learning
- 2024Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysis
- 2024A Preference-driven Paradigm for Enhanced Translation with Large Language Models
- 2025SimulPL: Aligning Human Preferences in Simultaneous Machine Translation
- 2024Advancing Translation Preference Modeling with RLHF: A Step Towards Cost-Effective Solution
- 2026From Utterance to Vividity: Training Expressive Subtitle Translation LLM via Adaptive Local Preference Optimization
- 2024Improving Context-Aware Preference Modeling for Language Models