mlsanityData to 14 Oct 2026

Multilingual Pre-training with Language and Task Adaptation for Multilingual Text Style Transfer

arXiv 2203.08552 ↗First posted 16 Mar 2022cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

We exploit the pre-trained seq2seq model mBART for multilingual text style transfer. Using machine translated data as well as gold aligned English sentences yields state-of-the-art results in the three target languages we consider. Besides, in view of the general scarcity of parallel data, we propose a modular approach for multilingual formality transfer, which consists of two training strategies that target adaptation to both language and task. Our approach achieves competitive performance without monolingual task-specific parallel data and can be applied to other style transfer tasks as well as to other languages.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 31 of its 34 references that are in the map. First posted on arXiv 16 Mar 2022.

Builds on

31 of 34 references.

References · 31

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  4. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  6. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
  7. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  8. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  9. 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 469
  10. 2020MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfercited by 445
  11. 2021XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languagescited by 347
  12. 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
19 more
  1. 2019Massively Multilingual Neural Machine Translationcited by 246
  2. 2019Simple, Scalable Adaptation for Neural Machine Translationcited by 242
  3. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
  4. 2018Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfercited by 191
  5. 2018Style Transfer Through Back-Translationcited by 124
  6. 2020UDapter: Language Adaptation for Truly Universal Dependency Parsingcited by 77
  7. 2019A Dual Reinforcement Learning Framework for Unsupervised Text Style Transfercited by 65
  8. 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 52
  9. 2020Expertise Style Transfer: A New Task Towards Better Communication between Experts and Laymencited by 45
  10. 2020Parallel Data Augmentation for Formality Style Transfercited by 39
  11. 2020Recipes for Adapting Pre-trained Monolingual and Multilingual Models to Machine Translationcited by 28
  12. 2021Thank you BART! Rewarding Pre-Trained Models Improves Formality Style Transfercited by 28
  13. 2019Domain, Translationese and Noise in Synthetic Data for Neural Machine Translationcited by 26
  14. 2021Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfercited by 25
  15. 2021Multilingual Unsupervised Neural Machine Translation with Denoising Adapterscited by 22
  16. 2021Multilingual Domain Adaptation for NMT: Decoupling Language and Domain Information with Adapterscited by 21
  17. 2020Reinforced Rewards Framework for Text Style Transfercited by 12
  18. 2021Generic resources are what you need: Style transfer tasks without task-specific parallel training datacited by 10
  19. 2020Robust Front-End for Multi-Channel ASR using Flow-Based Density Estimationcited by 9

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 4; 2024: 2.

8 papers.

  1. 2023Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxificationcited by 15
  2. 2024mEdIT: Multilingual Text Editing via Instruction Tuningcited by 13
  3. 2023Multidimensional Evaluation for Text Style Transfer Using ChatGPTcited by 12
  4. 2023Pre-Trained Language-Meaning Models for Multilingual Parsing and Generationcited by 10
  5. 2022Exploring Cross-lingual Textual Style Transfer with Large Multilingual Language Modelscited by 3
  6. 2022Event Extraction: A Surveycited by 3
  7. 2023Multilingual Bias Detection and Mitigation for Indian Languagescited by 1
  8. 2024UniPSDA: Unsupervised Pseudo Semantic Data Augmentation for Zero-Shot Cross-Lingual Natural Language Understandingcited by 0