mlsanityData to 14 Oct 2026

Exploring Cross-lingual Textual Style Transfer with Large Multilingual Language Models

arXiv 2206.02252 ↗First posted 5 Jun 2022cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Detoxification is a task of generating text in polite style while preserving meaning and fluency of the original toxic text. Existing detoxification methods are designed to work in one exact language. This work investigates multilingual and cross-lingual detoxification and the behavior of large multilingual models like in this setting. Unlike previous works we aim to make large language models able to perform detoxification without direct fine-tuning in given language. Experiments show that multilingual models are capable of performing multilingual style transfer. However, models are not able to perform cross-lingual detoxification and direct fine-tuning on exact language is inevitable.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 35 of its 44 references that are in the map. First posted on arXiv 5 Jun 2022.

Builds on

35 of 44 references.

References · 35

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  7. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  8. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  9. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  10. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  11. 2018Neural Network Acceptability Judgmentscited by 958
  12. 2020Language-agnostic BERT Sentence Embeddingcited by 627
23 more
  1. 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 248
  2. 2019Simple, Scalable Adaptation for Neural Machine Translationcited by 242
  3. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
  4. 2020Reformulating Unsupervised Style Transfer as Paraphrase Generationcited by 183
  5. 2020Deep Learning for Text Style Transfer: A Surveycited by 162
  6. 2018Conditional BERT Contextual Augmentationcited by 107
  7. 2019Multilingual Neural Machine Translation with Knowledge Distillationcited by 95
  8. 2019Beyond BLEU: Training Neural Machine Translation with Semantic Similaritycited by 84
  9. 2021Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approachcited by 75
  10. 2018Fighting Offensive Language on Social Media with Unsupervised Text Style Transfercited by 55
  11. 2020Controllable Text Simplification with Explicit Paraphrasingcited by 53
  12. 2021Paragraph-level Simplification of Medical Textscited by 53
  13. 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 52
  14. 2021Text Detoxification using Large Pre-trained Neural Modelscited by 52
  15. 2020Parallel Data Augmentation for Formality Style Transfercited by 39
  16. 2019Controllable Unsupervised Text Attribute Transfer via Editing Entangled Latent Representationcited by 34
  17. 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
  18. 2021Methods for Detoxification of Texts for the Russian Languagecited by 13
  19. 2021Improving Formality Style Transfer with Context-Aware Rule Injectioncited by 13
  20. 2022Multilingual Pre-training with Language and Task Adaptation for Multilingual Text Style Transfercited by 8
  21. 2020The Style-Content Duality of Attractiveness: Learning to Write Eye-Catching Headlines via Disentanglementcited by 7
  22. 2021VAE based Text Style Transfer with Pivot Words Enhancement Learningcited by 4
  23. 2018Style Transfer Through Multilingual and Feedback-Based Back-Translationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 0; 2026: 1.

3 papers.

  1. 2023Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxificationcited by 15
  2. 2024Multilingual and Explainable Text Detoxification with Parallel Corporacited by 12
  3. 2026A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Modelscited by 0