mlsanityData to 14 Oct 2026

Beyond "To whom it may concern": Tailoring Machine Translation to Audience and Intent

arXiv 2606.03259 ↗First posted 2 Jun 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Translation quality depends on purpose: the same source text demands different translations depending on audience, tone, and communicative intent. Yet MT models and metrics treat translation as a fixed mapping from source to target. LLMs enable users to explicitly specify purpose alongside source text, yet this capability has not been evaluated at scale. We introduce a systematic evaluation of purpose-driven MT across 50 languages, 5 model sizes and 8 text domains. We find that (1) explicit instructions substantially improve translation adaptedness, with larger gains on informal domains (conversation, social media), for larger model sizes and for higher-resource languages; (2) instructions outperform semantically-matched few-shot examples and paragraph-level context; (3) traditional MT metrics fail to capture adaptation quality, often penalizing adapted translations; (4) when curated instructions are unavailable, models can self-generate them from surrounding document context, closing up to 80% of the adaptedness gap to curated instructions. Our results establish that purpose-adapted MT is a viable and measurable capability of LLMs, while highlighting the need for purpose-aware metrics.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 45 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

20 of 45 references.

References · 20

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 560
  3. 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 265
  4. 2019Getting Gender Right in Neural Machine Translationcited by 98
  5. 2024MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Taskcited by 93
  6. 2025WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialectscited by 79
  7. 2024Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translationcited by 62
  8. 2022MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translationcited by 38
  9. 2019Controlling Text Complexity in Neural Machine Translationcited by 32
  10. 2025Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challengescited by 31
  11. 2022CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formalitycited by 24
  12. 2025BOUQuET: dataset, Benchmark and Open initiative for Universal Quality Evaluation in Translationcited by 22
8 more
  1. 2024Prompting ChatGPT for Translation: A Comparative Analysis of Translation Brief and Persona Promptscited by 12
  2. 2023Optimizing Machine Translation through Prompt Engineering: An Investigation into ChatGPT's Customizabilitycited by 11
  3. 2024Fine-Grained and Multi-Dimensional Metrics for Document-Level Machine Translationcited by 10
  4. 2025Please Translate Again: Two Simple Experiments on Whether Human-Like Reasoning Helps Translationcited by 7
  5. 2025An Interdisciplinary Approach to Human-Centered Machine Translationcited by 6
  6. 2024Low-resource Machine Translation: what for? who for? An observational study on a dedicated Tetun language translation servicecited by 5
  7. 2025Specification-Aware Machine Translation and Evaluation for Purpose Alignmentcited by 4
  8. 2026Culture-Aware Machine Translation in Large Language Models: Benchmarking and Investigationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.