mlsanityData to 14 Oct 2026

Better Literary Translation: A Multi-Aspect Data Generation and LLM Training Approach

arXiv 2606.05924 ↗First posted 4 Jun 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Literary translation poses unique challenges due to the scarcity of high-quality annotated data and the need to balance expression fluency with literary effect. We present a multi-aspect iterative refinement framework that generates high-quality translation references and preference data through specialized LLM translators, each targeting a distinct quality dimension. We leverage the generated data for supervised fine-tuning and reinforcement learning. Experiments show that our generated references outperform the original ground truth for SFT by 8.65 CEA100 points. For reinforcement learning, we find that DPO leads to performance degradation in this setting, while leveraging an explicit reward model for GRPO yields an additional 1.51 point improvement. We attribute this to the stability of two-stage training and GRPO's online exploration capability. Our resulting models, LitMT-8B and LitMT-14B, achieve 67.25 and 69.07 CEA100 respectively on the MetaphorTrans English-to-Chinese literary translation benchmark, competitive with Claude Sonnet 4.5 at 68.43, and demonstrate strong generalization to out-of-domain literary work (i.e., O. Henry).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

16 of 27 references.

References · 16

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  5. 2020Learning to summarize from human feedbackcited by 2,588
  6. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  7. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
  8. 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 420
  9. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
  10. 2023Statistical Rejection Sampling Improves Preference Optimizationcited by 323
  11. 2023Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hackingcited by 200
  12. 2024X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scalecited by 36
4 more
  1. 2024DRT: Deep Reasoning Translation via Long Chain-of-Thoughtcited by 29
  2. 2024Synthesizing Post-Training Data for LLMs through Multi-Agent Simulationcited by 24
  3. 2025ExTrans: Multilingual Deep Reasoning Translation via Exemplar-Enhanced Reinforcement Learningcited by 11
  4. 2022Creativity in translation: machine translation as a constraint for literary textscited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reference-Free Post-Training of Open Large Language Models for Multilingual Machine Translation
  2. 2026Generating Adversarial Texts for Machine Translation via GRPO
  3. 2025SSR-Zero: Simple Self-Rewarding Reinforcement Learning for Machine Translation
  4. 2026Translate-R1: Cost-Aware Translation Tool Use via Reinforcement Learning
  5. 2026PEGRL: Improving Machine Translation by Post-Editing Guided Reinforcement Learning
  6. 2025RIVAL: Reinforcement Learning with Iterative and Adversarial Optimization for Machine Translation
  7. 2025Seed-X: Building Strong Multilingual Translation LLM with 7B Parameters
  8. 2026Rewrite to Translate, Translate to Reward: Reinforcement Learning for Source Rewriting in Machine Translation