Beyond "To whom it may concern": Tailoring Machine Translation to Audience and Intent
Not on the map. Why?
Abstract (arXiv)
Translation quality depends on purpose: the same source text demands different translations depending on audience, tone, and communicative intent. Yet MT models and metrics treat translation as a fixed mapping from source to target. LLMs enable users to explicitly specify purpose alongside source text, yet this capability has not been evaluated at scale. We introduce a systematic evaluation of purpose-driven MT across 50 languages, 5 model sizes and 8 text domains. We find that (1) explicit instructions substantially improve translation adaptedness, with larger gains on informal domains (conversation, social media), for larger model sizes and for higher-resource languages; (2) instructions outperform semantically-matched few-shot examples and paragraph-level context; (3) traditional MT metrics fail to capture adaptation quality, often penalizing adapted translations; (4) when curated instructions are unavailable, models can self-generate them from surrounding document context, closing up to 80% of the adaptedness gap to curated instructions. Our results establish that purpose-adapted MT is a viable and measurable capability of LLMs, while highlighting the need for purpose-aware metrics.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 45 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
20 of 45 references.
References · 20
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 560
- 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 265
- 2019Getting Gender Right in Neural Machine Translationcited by 98
- 2024MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Taskcited by 93
- 2025WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialectscited by 79
- 2024Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translationcited by 62
- 2022MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translationcited by 38
- 2019Controlling Text Complexity in Neural Machine Translationcited by 32
- 2025Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challengescited by 31
- 2022CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formalitycited by 24
- 2025BOUQuET: dataset, Benchmark and Open initiative for Universal Quality Evaluation in Translationcited by 22
8 more
- 2024Prompting ChatGPT for Translation: A Comparative Analysis of Translation Brief and Persona Promptscited by 12
- 2023Optimizing Machine Translation through Prompt Engineering: An Investigation into ChatGPT's Customizabilitycited by 11
- 2024Fine-Grained and Multi-Dimensional Metrics for Document-Level Machine Translationcited by 10
- 2025Please Translate Again: Two Simple Experiments on Whether Human-Like Reasoning Helps Translationcited by 7
- 2025An Interdisciplinary Approach to Human-Centered Machine Translationcited by 6
- 2024Low-resource Machine Translation: what for? who for? An observational study on a dedicated Tetun language translation servicecited by 5
- 2025Specification-Aware Machine Translation and Evaluation for Purpose Alignmentcited by 4
- 2026Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigationcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.