Controlling Translation Formality Using Pre-trained Multilingual Language Models
Not on the map. Why?
Abstract (arXiv)
This paper describes the University of Maryland's submission to the Special Task on Formality Control for Spoken Language Translation at iwslt, which evaluates translation from English into 6 languages with diverse grammatical formality markers. We investigate to what extent this problem can be addressed with a textitsingle multilingual model, simultaneously controlling its output for target language and formality. Results show that this strategy can approach the translation quality and formality control achieved by dedicated translation models. However, the nature of the underlying pre-trained language model and of the finetuning samples greatly impact results.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 13 May 2022.
Builds on
17 of 33 references.
References · 17
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2019WikiMatrix: Mining 135M Parallel Sentences in 1620 Language Pairs from Wikipediacited by 221
- 2019CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEBcited by 177
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
- 2016Personalized Machine Translation: Preserving Original Author Traitscited by 47
- 2020TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restylingcited by 39
- 2020Incorporating BERT into Parallel Sequence Decoding with Adapterscited by 39
- 2019Controlling Text Complexity in Neural Machine Translationcited by 32
- 2021Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitutioncited by 31
- 2022CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formalitycited by 24
5 more
- 2021Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfercited by 23
- 2019JParaCrawl: A Large Scale Web-Based English-Japanese Parallel Corpuscited by 21
- 2021Few-shot Controllable Style Transfer for Low-Resource Multilingual Settingscited by 20
- 2019Controlling Neural Machine Translation Formality with Synthetic Supervisioncited by 18
- 2017JESC: Japanese-English Subtitle Corpuscited by 16
Built on by
Citing papers per year: 2023: 8; 2024: 2; 2025: 4.
14 papers.
Sort:
By area:
- 2023The unreasonable effectiveness of few-shot learning for machine translationcited by 91
- 2024The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilitiescited by 22
- 2023Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interactioncited by 16
- 2025An Interdisciplinary Approach to Human-Centered Machine Translationcited by 6
- 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMscited by 6
- 2025Towards Style Alignment in Cross-Cultural Translationcited by 4
- 2023In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languagescited by 2
- 2023MTCue: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translationcited by 2
- 2023How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?cited by 2
- 2023Comparing Styles across Languages: A Cross-Cultural Exploration of Politenesscited by 2
- 2024On Instruction-Finetuning Neural Machine Translation Modelscited by 2
- 2023Data-Driven Approach for Formality-Sensitive Machine Translation: Language-Specific Handling and Synthetic Data Generationcited by 0
- 2025When the Gold Standard Isn't Necessarily Standard: Challenges of Evaluating the Translation of User-Generated Content19 Dec 2025
- 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMs18 Dec 2025
- 2025Towards Style Alignment in Cross-Cultural Translation30 Jun 2025
- 2025An Interdisciplinary Approach to Human-Centered Machine Translation16 Jun 2025
- 2024On Instruction-Finetuning Neural Machine Translation Models7 Oct 2024
- 2024The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilities30 May 2024
- 2023Machine Translation to Control Formality Features in the Target Language22 Nov 2023
- 2023Comparing Styles across Languages: A Cross-Cultural Exploration of Politeness11 Oct 2023
- 2023How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?15 Sep 2023
- 2023Data-Driven Approach for Formality-Sensitive Machine Translation: Language-Specific Handling and Synthetic Data Generation26 Jun 2023
- 2023MTCue: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translation25 May 2023
- 2023In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages23 Feb 2023
- 2024The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilitiescited by 22
- 2023Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interactioncited by 16
- 2025An Interdisciplinary Approach to Human-Centered Machine Translationcited by 6
- 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMscited by 6
- 2025Towards Style Alignment in Cross-Cultural Translationcited by 4
- 2023In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languagescited by 2
- 2023MTCue: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translationcited by 2
- 2023How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?cited by 2
- 2023Comparing Styles across Languages: A Cross-Cultural Exploration of Politenesscited by 2
- 2024On Instruction-Finetuning Neural Machine Translation Modelscited by 2
- 2023Machine Translation to Control Formality Features in the Target Languagecited by 0
- 2025When the Gold Standard Isn't Necessarily Standard: Challenges of Evaluating the Translation of User-Generated Contentcited by 0
- 2025When the Gold Standard Isn't Necessarily Standard: Challenges of Evaluating the Translation of User-Generated Content19 Dec 2025
- 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMs18 Dec 2025
- 2025Towards Style Alignment in Cross-Cultural Translation30 Jun 2025
- 2025An Interdisciplinary Approach to Human-Centered Machine Translation16 Jun 2025
- 2024On Instruction-Finetuning Neural Machine Translation Models7 Oct 2024
- 2024The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilities30 May 2024
- 2023Machine Translation to Control Formality Features in the Target Language22 Nov 2023
- 2023Comparing Styles across Languages: A Cross-Cultural Exploration of Politeness11 Oct 2023
- 2023How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?15 Sep 2023
- 2023MTCue: Learning Zero-Shot Control of Extra-Textual Attributes by Leveraging Unstructured Context in Neural Machine Translation25 May 2023
- 2023In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages23 Feb 2023
- 2023Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction24 Jan 2023