Extreme Adaptation for Personalized Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
Every person speaks or writes their own flavor of their native language, influenced by a number of factors: the content they tend to talk about, their gender, their social status, or their geographical origin. When attempting to perform Machine Translation (MT), these variations have a significant effect on how the system should perform translation, but this is not captured well by standard one-size-fits-all models. In this paper, we propose a simple and parameter-efficient adaptation technique that only requires adapting the bias of the output softmax to each particular user of the MT system, either directly or through a factored approximation. Experiments on TED talks in three languages demonstrate improvements in translation accuracy, and better reflection of speaker traits in the target text.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 6; 2023: 10; 2024: 2; 2025: 1.
27 papers.
Sort:
By area:
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 321
- 2023Tool Learning with Foundation Modelscited by 302
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 87
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2022CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formalitycited by 24
- 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Surveycited by 23
- 2021Machine Translation Verbosity Control for Automatic Dubbingcited by 18
- 2022FRMT: A Benchmark for Few-Shot Region-Aware Machine Translationcited by 18
- 2021Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translationcited by 15
- 2024What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Studycited by 15
- 2021Towards User-Driven Neural Machine Translationcited by 10
15 more
- 2023RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translationcited by 9
- 2021Towards Universality in Multilingual Text Rewritingcited by 7
- 2022Controlling Styles in Neural Machine Translation with Activation Promptcited by 7
- 2023Towards a Unified Conversational Recommendation System: Multi-task Learning via Contextualized Knowledge Distillationcited by 4
- 2022Controlling Extra-Textual Attributes about Dialogue Participants -- A Case Study of English-to-Polish Neural Machine Translationcited by 3
- 2023Reference-less Analysis of Context Specificity in Translation with Personalised Language Modelscited by 3
- 2025Steering Large Language Models for Machine Translation Personalizationcited by 3
- 2023MTCue: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translationcited by 2
- 2023How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?cited by 2
- 2021Synthesizing Monolingual Data for Neural Machine Translationcited by 1
- 2022PePe: Personalized Post-editing Model utilizing User-generated Post-editscited by 1
- 2023Pluggable Neural Machine Translation Models via Memory-augmented Adapterscited by 1
- 2024Diverse Sign Language Translationcited by 1
- 2023Unified Model Learning for Various Neural Machine Translationcited by 0
- 2023Incorporating Human Translator Style into English-Turkish Literary Machine Translationcited by 0
- 2025Steering Large Language Models for Machine Translation Personalization22 May 2025
- 2024Diverse Sign Language Translation25 Oct 2024
- 2024What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Study1 Oct 2024
- 2023Towards a Unified Conversational Recommendation System: Multi-task Learning via Contextualized Knowledge Distillation27 Oct 2023
- 2023How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?15 Sep 2023
- 2023Incorporating Human Translator Style into English-Turkish Literary Machine Translation21 Jul 2023
- 2023Pluggable Neural Machine Translation Models via Memory-augmented Adapters12 Jul 2023
- 2023RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translation26 May 2023
- 2023MTCue: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translation25 May 2023
- 2023Unified Model Learning for Various Neural Machine Translation4 May 2023
- 2023Tool Learning with Foundation Models17 Apr 2023
- 2023Reference-less Analysis of Context Specificity in Translation with Personalised Language Models29 Mar 2023
15 more
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback9 Mar 2023
- 2022Controlling Styles in Neural Machine Translation with Activation Prompt17 Dec 2022
- 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Survey6 Nov 2022
- 2022FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation1 Oct 2022
- 2022PePe: Personalized Post-editing Model utilizing User-generated Post-edits21 Sep 2022
- 2022Controlling Extra-Textual Attributes about Dialogue Participants -- A Case Study of English-to-Polish Neural Machine Translation10 May 2022
- 2022CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formality9 May 2022
- 2021Machine Translation Verbosity Control for Automatic Dubbing8 Oct 2021
- 2021Towards Universality in Multilingual Text Rewriting30 Jul 2021
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models18 Jun 2021
- 2021Towards User-Driven Neural Machine Translation11 Jun 2021
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey14 Apr 2021
- 2021Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translation25 Mar 2021
- 2021Membership Inference Attacks on Machine Learning: A Survey14 Mar 2021
- 2021Synthesizing Monolingual Data for Neural Machine Translation29 Jan 2021
- 2023Tool Learning with Foundation Modelscited by 302
- 2023Tool Learning with Foundation Models17 Apr 2023
- 2021Membership Inference Attacks on Machine Learning: A Surveycited by 321
- 2021Membership Inference Attacks on Machine Learning: A Survey14 Mar 2021
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2022CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formalitycited by 24
- 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Surveycited by 23
- 2021Machine Translation Verbosity Control for Automatic Dubbingcited by 18
- 2022FRMT: A Benchmark for Few-Shot Region-Aware Machine Translationcited by 18
- 2021Pruning-then-Expanding Model for Domain Adaptation of Neural Machine Translationcited by 15
- 2024What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Studycited by 15
- 2021Towards User-Driven Neural Machine Translationcited by 10
- 2023RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translationcited by 9
- 2021Towards Universality in Multilingual Text Rewritingcited by 7
- 2022Controlling Styles in Neural Machine Translation with Activation Promptcited by 7
12 most cited of 22 All 22 (JSON)
- 2024Diverse Sign Language Translation25 Oct 2024
- 2024What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Study1 Oct 2024
- 2023How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?15 Sep 2023
- 2023Incorporating Human Translator Style into English-Turkish Literary Machine Translation21 Jul 2023
- 2023Pluggable Neural Machine Translation Models via Memory-augmented Adapters12 Jul 2023
- 2023RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translation26 May 2023
- 2023MTCue: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translation25 May 2023
- 2023Unified Model Learning for Various Neural Machine Translation4 May 2023
- 2023Reference-less Analysis of Context Specificity in Translation with Personalised Language Models29 Mar 2023
- 2022Controlling Styles in Neural Machine Translation with Activation Prompt17 Dec 2022
- 2022On the Domain Adaptation and Generalization of Pretrained Language Models: A Survey6 Nov 2022
- 2022FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation1 Oct 2022
12 newest of 22 All 22 (JSON)