mlsanityData to 7 Oct 2026

XFORMAL: A Benchmark for Multilingual Formality Style Transfer

arXiv 2104.04108 ↗First posted 8 Apr 2021cs.CL cs.AIcited by 51

Not on the map. Why?

Abstract (arXiv)

We take the first step towards multilingual style transfer by creating and releasing XFORMAL, a benchmark of multiple formal reformulations of informal text in Brazilian Portuguese, French, and Italian. Results on XFORMAL suggest that state-of-the-art style transfer approaches perform close to simple baselines, indicating that style transfer is even more challenging when moving multilingual.

Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). Builds on 41 of its 68 references that are in the map. First posted on arXiv 8 Apr 2021.

Builds on

41 of 68 references.

References · 41

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  3. 2018Datasheets for Datasetscited by 1,371
  4. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
  5. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 784
  6. 2019On the Cross-lingual Transferability of Monolingual Representationscited by 575
  7. 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 517
  8. 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 484
  9. 2017Toward Controlled Generation of Textcited by 271
  10. 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 246
  11. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 209
  12. 2018Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfercited by 191
29 more
  1. 2020Reformulating Unsupervised Style Transfer as Paraphrase Generationcited by 181
  2. 2018Style Transfer Through Back-Translationcited by 124
  3. 2020BLEU might be Guilty but References are not Innocentcited by 109
  4. 2019Getting Gender Right in Neural Machine Translationcited by 98
  5. 2020A Probabilistic Formulation of Unsupervised Text Style Transfercited by 70
  6. 2019A Dual Reinforcement Learning Framework for Unsupervised Text Style Transfercited by 65
  7. 2019Evaluating Style Transfer for Textcited by 59
  8. 2018Unpaired Sentiment-to-Sentiment Translation: A Cycled Reinforcement Learning Approachcited by 55
  9. 2016Personalized Machine Translation: Preserving Original Author Traitscited by 47
  10. 2018Content preserving text generation with attribute controlscited by 47
  11. 2020Expertise Style Transfer: A New Task Towards Better Communication between Experts and Laymencited by 45
  12. 2020Parallel Data Augmentation for Formality Style Transfercited by 39
  13. 2019Reinforcement Learning Based Text Style Transfer without Parallel Training Corpuscited by 38
  14. 2018Neural Machine Translation Decoding with Terminology Constraintscited by 36
  15. 2019IMaT: Unsupervised Text Attribute Transfer via Iterative Matching and Translationcited by 33
  16. 2019Controlling Text Complexity in Neural Machine Translationcited by 32
  17. 2018Multi-Task Neural Models for Translating Between Styles Within and Across Languagescited by 28
  18. 2019Filling Gender & Number Gaps in Neural Machine Translation with Black-box Context Injectioncited by 27
  19. 2019Domain Adaptive Text Style Transfercited by 25
  20. 2020Style-transfer and Paraphrase: Looking for a Sensible Semantic Similarity Metriccited by 23
  21. 2019Semi-supervised Text Style Transfer: Cross Projection in Latent Spacecited by 21
  22. 2018Multiple-Attribute Text Style Transfercited by 20
  23. 2019A Hierarchical Reinforced Sequence Operation Method for Unsupervised Text Style Transfercited by 20
  24. 2019Style Transfer for Texts: Retrain, Report Errors, Compare with Rewritescited by 19
  25. 2019Controlling Neural Machine Translation Formality with Synthetic Supervisioncited by 18
  26. 2020The Sockeye 2 Neural Machine Translation Toolkit at AMTA 2020cited by 16
  27. 2015SQUINKY! A Corpus of Sentence-level Formality, Informativeness, and Implicaturecited by 11
  28. 2019(Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Annotated Stylistic Language Dataset with Multiple Personascited by 10
  29. 2019Grammatical Error Correction and Style Transfer via Zero-shot Monolingual Translationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 10; 2023: 14; 2024: 12; 2025: 5; 2026: 5.

51 papers.

Sort:

By area:

  1. 2024Multi-property Steering of Large Language Models with Dynamic Activation Compositioncited by 35
  2. 2022NEWTS: A Corpus for News Topic-Focused Summarizationcited by 27
  3. 2023Revisiting non-English Text Simplification: A Unified Multilingual Benchmarkcited by 27
  4. 2021Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfercited by 23
  5. 2022TyDiP: A Dataset for Politeness Classification in Nine Typologically Diverse Languagescited by 21
  6. 2021Few-shot Controllable Style Transfer for Low-Resource Multilingual Settingscited by 20
  7. 2022IT5: Text-to-text Pretraining for Italian Language Understanding and Generationcited by 20
  8. 2021A Review of Human Evaluation for Style Transfercited by 19
  9. 2023ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfercited by 18
  10. 2024Can AI Be as Creative as Humans?cited by 17
  11. 2024Advanced Natural-based interaction for the ITAlian language: LLaMAntino-3-ANITAcited by 17
  12. 2023Exploring Methods for Cross-lingual Text Style Transfer: The Case of Text Detoxificationcited by 15
38 more
  1. 2023A Call for Standardization and Validation of Text Style Transfer Evaluationcited by 13
  2. 2023Camoscio: an Italian Instruction-tuned LLaMAcited by 13
  3. 2024mEdIT: Multilingual Text Editing via Instruction Tuningcited by 13
  4. 2024MultiParaDetox: Extending Text Detoxification with Parallel Data to New Languagescited by 13
  5. 2022Semi-Supervised Formality Style Transfer with Consistency Trainingcited by 12
  6. 2024Multilingual and Explainable Text Detoxification with Parallel Corporacited by 12
  7. 2022Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfercited by 11
  8. 2022Detecting Text Formality: A Study of Text Classification Approachescited by 11
  9. 2024GPTs Are Multilingual Annotators for Sequence Generation Taskscited by 11
  10. 2023RAMP: Retrieval and Attribute-Marking Enhanced Prompting for Attribute-Controlled Translationcited by 9
  11. 2023Learning to Generate Text in Arbitrary Writing Stylescited by 9
  12. 2024Multilingual Text Style Transfer: Datasets & Models for Indian Languagescited by 9
  13. 2022Multilingual Pre-training with Language and Task Adaptation for Multilingual Text Style Transfercited by 8
  14. 2024NAP^2: A Benchmark for Naturalness and Privacy-Preserving Text Rewriting by Learning from Humancited by 8
  15. 2021Towards Universality in Multilingual Text Rewritingcited by 7
  16. 2022CrisisLTLSum: A Benchmark for Local Crisis Event Timeline Extraction and Summarizationcited by 6
  17. 2021From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Surveycited by 5
  18. 2023A Block Metropolis-Hastings Sampler for Controllable Energy-based Text Generationcited by 5
  19. 2022StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfercited by 4
  20. 2023Conversation Style Transfer using Few-Shot Learningcited by 4
  21. 2024Spivavtor: An Instruction Tuned Ukrainian Text Editing Modelcited by 4
  22. 2025SynthDetoxM: Modern LLMs are Few-Shot Parallel Detoxification Data Annotatorscited by 4
  23. 2025LLM in the Loop: Creating the ParaDeHate Dataset for Hate Speech Detoxificationcited by 4
  24. 2025Towards Style Alignment in Cross-Cultural Translationcited by 4
  25. 2022Exploring Cross-lingual Textual Style Transfer with Large Multilingual Language Modelscited by 3
  26. 2023In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languagescited by 2
  27. 2023Comparing Styles across Languages: A Cross-Cultural Exploration of Politenesscited by 2
  28. 2023PEMA: An Offsite-Tunable Plug-in External Memory Adaptation for Language Modelscited by 2
  29. 2025Evaluating Text Style Transfer: A Nine-Language Benchmark for Text Detoxificationcited by 2
  30. 2023Controllable Topic-Focused Abstractive Summarizationcited by 1
  31. 2024FAME-MT Dataset: Formality Awareness Made Easy for Machine Translation Purposescited by 1
  32. 2024Positive Text Reframing under Multi-strategy Optimizationcited by 1
  33. 2025mStyleDistance: Multilingual Style Embeddings and their Evaluationcited by 1
  34. 2023Learning a Formality-Aware Japanese Sentence Representationcited by 0
  35. 2026RT-SFT: Text Style Transfer from Non-Parallel Corpora by Roundtrip Translationcited by 0
  36. 2026A Universal Vibe? Finding and Controlling Language-Agnostic Informal Register with SAEscited by 0
  37. 2026Casual as an Anchor: Resolving Supervision Misalignment in Formality Transfer Datasetcited by 0
  38. 2026A Cross-lingual Comparison of Human and Classification Model Entrainment Behavior in Code-switched Speech Settingscited by 0

50 most cited of 51 All 51 (JSON)