Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfer
Not on the map. Why?
Abstract (arXiv)
Style transfer is the task of automatically transforming a piece of text in one particular style into another. A major barrier to progress in this field has been a lack of training and evaluation datasets, as well as benchmarks and automatic metrics. In this work, we create the largest corpus for a particular stylistic transfer (formality) and show that techniques from the machine translation community can serve as strong baselines for future work. We also discuss challenges of using automatic metrics.
Key facts. Cited by 209 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 45; 2023: 51; 2024: 37; 2025: 20; 2026: 17.
209 papers.
Sort:
By area:
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
- 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 240
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 196
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 147
- 2024Benchmarking Complex Instruction-Following with Multiple Constraints Compositioncited by 147
- 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
- 2021The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generationcited by 96
- 2023Controlled Text Generation with Natural Language Instructionscited by 87
- 2022Same Author or Just Same Topic? Towards Content-Independent Style Representationscited by 83
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraintscited by 70
- 2023CoEdIT: Text Editing by Task-Specific Instruction Tuningcited by 67
38 more
- 2023RewriteLM: An Instruction-Tuned Large Language Model for Text Rewritingcited by 67
- 2022Mix and Match: Learning-free Controllable Text Generation using Energy Language Modelscited by 66
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmarkcited by 62
- 2022Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decodingcited by 54
- 2022LENS: A Learnable Evaluation Metric for Text Simplificationcited by 54
- 2021Text Detoxification using Large Pre-trained Neural Modelscited by 52
- 2021XFORMAL: A Benchmark for Multilingual Formality Style Transfercited by 51
- 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Modelscited by 49
- 2023ChatGPT vs Human-authored Text: Insights into Controllable Text Summarization and Sentence Style Transfercited by 49
- 2023Teach LLMs to Personalize -- An Approach inspired by Writing Educationcited by 48
- 2022Controllable Text Generation with Neurally-Decomposed Oraclecited by 41
- 2024Multi-property Steering of Large Language Models with Dynamic Activation Compositioncited by 35
- 2021StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfercited by 34
- 2021Civil Rephrases Of Toxic Texts With Self-Supervised Transformerscited by 32
- 2022Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a Few Utterancescited by 32
- 2024StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examplescited by 32
- 2022Inducing Positive Perspectives with Text Reframingcited by 31
- 2023Training Models to Generate, Recognize, and Reframe Unhelpful Thoughtscited by 31
- 2023Learning Interpretable Style Embeddings via Prompting LLMscited by 29
- 2021Thank you BART! Rewarding Pre-Trained Models Improves Formality Style Transfercited by 28
- 2022Composable Text Controls in Latent Space with ODEscited by 28
- 2022Text Style Transfer for Bias Mitigation using Masked Language Modelingcited by 27
- 2023Don't lose the message while paraphrasing: A study on content preserving style transfercited by 25
- 2022CoCoA-MT: A Dataset and Benchmark for Contrastive Controlled MT with Application to Formalitycited by 24
- 2023ALDi: Quantifying the Arabic Level of Dialectness of Textcited by 24
- 2024Style-Specific Neurons for Steering LLMs in Text Style Transfercited by 24
- 2021Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfercited by 23
- 2024Under the Surface: Tracking the Artifactuality of LLM-Generated Datacited by 23
- 2022TyDiP: A Dataset for Politeness Classification in Nine Typologically Diverse Languagescited by 21
- 2021Few-shot Controllable Style Transfer for Low-Resource Multilingual Settingscited by 20
- 2022IT5: Text-to-text Pretraining for Italian Language Understanding and Generationcited by 20
- 2022Improving Iterative Text Revision by Learning Where to Edit from Other Revision Taskscited by 20
- 2021A Review of Human Evaluation for Style Transfercited by 19
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021A Review of Text Style Transfer using Deep Learningcited by 18
- 2024Threads of Subtlety: Detecting Machine-Generated Texts Through Discourse Motifscited by 18
- 2021Does It Capture STEL? A Modular, Similarity-based Linguistic Style Evaluation Frameworkcited by 17
- 2022Text Revision by On-the-Fly Representation Optimizationcited by 17
50 most cited of 209 All 209 (JSON)
- 2026FAVoR: Measuring and Mitigating Author-Style Homogenization in Federated Personalized Generation25 Sep 2026
- 2026Evaluating Communicative Success in Machine-Translated Conversation17 Sep 2026
- 2026Can Activation Steering Capture Multidimensional Authorship Style?4 Sep 2026
- 2026PragAlign: Evidence-Sensitive Reply Assistance Across Chinese and Japanese Appropriateness Judgments27 Aug 2026
- 2026Do Recipes Have Personas? Characterizing and Generating Creator Style in Attributed Procedural Graphs25 Aug 2026
- 2026Bridging the Usability Gap: Lessons from Interpreting Studies for Machine Interpreting Design14 Jun 2026
- 2026Casual as an Anchor: Resolving Supervision Misalignment in Formality Transfer Dataset28 May 2026
- 2026Steering Without Breaking: Mechanistically Informed Interventions for Discrete Diffusion Language Models8 May 2026
- 2026Learn-To-Learn on Arbitrary Textual Conditioning: A Hypernetwork-Driven Meta-Gated LLM3 May 2026
- 2026Stealthy Backdoor Attacks against LLMs Based on Natural Style Triggers23 Apr 2026
- 2026Please Make it Sound like Human: Encoder-Decoder vs. Decoder-Only Transformers for AI-to-Human Text Style Transfer13 Apr 2026
- 2026TEMPER: Testing Emotional Perturbation in Quantitative Reasoning9 Apr 2026
38 more
- 2026Not My Truce: Personality Differences in AI-Mediated Workplace Negotiation1 Apr 2026
- 2026A Universal Vibe? Finding and Controlling Language-Agnostic Informal Register with SAEs27 Mar 2026
- 2026Answer Bubbles: Information Exposure in AI-Mediated Search17 Mar 2026
- 2026RT-SFT: Text Style Transfer from Non-Parallel Corpora by Roundtrip Translation16 Feb 2026
- 2026Who Gets Which Message? Auditing Demographic Bias in LLM-Generated Targeted Text23 Jan 2026
- 2025Social Perceptions of English Spelling Variation on Twitter: A Comparative Analysis of Human and LLM Responses28 Nov 2025
- 2025Charting the European LLM Benchmarking Landscape: A New Taxonomy and a Set of Best Practices28 Oct 2025
- 2025Controllable Stylistic Text Generation with Train-Time Attribute-Regularized Diffusion7 Oct 2025
- 2025Does AI Coaching Prepare us for Workplace Negotiations?26 Sep 2025
- 2025CURE: Controlled Unlearning for Robust Embeddings -- Mitigating Conceptual Shortcuts in Pre-Trained Language Models5 Sep 2025
- 2025CoBA: Counterbias Text Augmentation for Mitigating Various Spurious Correlations via Semantic Triples26 Aug 2025
- 2025StyleAdaptedLM: Enhancing Instruction Following Models with Efficient Stylistic Transfer24 Jul 2025
- 2025Evaluating Text Style Transfer: A Nine-Language Benchmark for Text Detoxification21 Jul 2025
- 2025Towards Style Alignment in Cross-Cultural Translation30 Jun 2025
- 2025Bridging Compositional and Distributional Semantics: A Survey on Latent Semantic Geometry via AutoEncoder25 Jun 2025
- 2025SCISSOR: Mitigating Semantic Bias through Cluster-Aware Siamese Networks for Robust Classification17 Jun 2025
- 2025LLM in the Loop: Creating the ParaDeHate Dataset for Hate Speech Detoxification2 Jun 2025
- 2025Research Borderlands: Analysing Writing Across Research Cultures1 Jun 2025
- 2025Implementing Long Text Style Transfer with LLMs through Dual-Layered Sentence and Paragraph Structure Extraction and Mapping11 May 2025
- 2025Steering Large Language Models with Register Analysis for Arbitrary Style Transfer1 May 2025
- 2025Interpersonal Theory of Suicide as a Lens to Examine Suicidal Ideation in Online Spaces17 Apr 2025
- 2025Linguistic Comparison of AI- and Human-Written Responses to Online Mental Health Queries12 Apr 2025
- 2025Dr Genre: Reinforcement Learning from Decoupled LLM Feedback for Generic Text Rewriting9 Mar 2025
- 2025SynthDetoxM: Modern LLMs are Few-Shot Parallel Detoxification Data Annotators10 Feb 2025
- 2025Challenging Assumptions in Learning Generic Text Style Embeddings27 Jan 2025
- 2024Multilingual and Explainable Text Detoxification with Parallel Corpora16 Dec 2024
- 2024StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examples16 Oct 2024
- 2024DiDOTS: Knowledge Distillation from Large-Language-Models for Dementia Obfuscation in Transcribed Speech5 Oct 2024
- 2024Style-Specific Neurons for Steering LLMs in Text Style Transfer1 Oct 2024
- 2024FiSTECH: Financial Style Transfer to Enhance Creativity without Hallucinations in LLMs9 Aug 2024
- 2024A Survey of Text Style Transfer: Applications and Ethical Implications23 Jul 2024
- 2024SETTP: Style Extraction and Tunable Inference via Dual-level Transferable Prompt Learning22 Jul 2024
- 2024Text Style Transfer: An Introductory Overview20 Jul 2024
- 2024Self-interpreting Adversarial Images12 Jul 2024
- 2024Benchmarking Complex Instruction-Following with Multiple Constraints Composition4 Jul 2024
- 2024Multi-property Steering of Large Language Models with Dynamic Activation Composition25 Jun 2024
- 2024TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddings21 Jun 2024
- 2024Style Transfer with Multi-iteration Preference Optimization17 Jun 2024
50 newest of 209 All 209 (JSON)
- 2023Fine-grained Text Style Transfer with Diffusion-Based Language Modelscited by 7
- 2025Controllable Stylistic Text Generation with Train-Time Attribute-Regularized Diffusioncited by 2
- 2026Steering Without Breaking: Mechanistically Informed Interventions for Discrete Diffusion Language Modelscited by 2
- 2023GlyphDiffusion: Text Generation as Image Generationcited by 1
- 2026Steering Without Breaking: Mechanistically Informed Interventions for Discrete Diffusion Language Models8 May 2026
- 2025Controllable Stylistic Text Generation with Train-Time Attribute-Regularized Diffusion7 Oct 2025
- 2023Fine-grained Text Style Transfer with Diffusion-Based Language Models31 May 2023
- 2023GlyphDiffusion: Text Generation as Image Generation25 Apr 2023
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfercited by 147
- 2026Stealthy Backdoor Attacks against LLMs Based on Natural Style Triggerscited by 1
- 2025CURE: Controlled Unlearning for Robust Embeddings -- Mitigating Conceptual Shortcuts in Pre-Trained Language Modelscited by 0
- 2026Stealthy Backdoor Attacks against LLMs Based on Natural Style Triggers23 Apr 2026
- 2025CURE: Controlled Unlearning for Robust Embeddings -- Mitigating Conceptual Shortcuts in Pre-Trained Language Models5 Sep 2025
- 2021Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer14 Oct 2021
- 2023Towards an On-device Agent for Text Rewritingcited by 7
- 2023Towards an On-device Agent for Text Rewriting22 Aug 2023
- 2024Self-interpreting Adversarial Imagescited by 7
- 2024Self-interpreting Adversarial Images12 Jul 2024
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
- 2023In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringcited by 240
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2023"Kelly is a Warm Person, Joseph is a Role Model": Gender Biases in LLM-Generated Reference Letterscited by 196
- 2024Benchmarking Complex Instruction-Following with Multiple Constraints Compositioncited by 147
- 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
- 2021The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generationcited by 96
- 2023Controlled Text Generation with Natural Language Instructionscited by 87
- 2022Same Author or Just Same Topic? Towards Content-Independent Style Representationscited by 83
- 2021Controlled Text Generation as Continuous Optimization with Multiple Constraintscited by 70
- 2023CoEdIT: Text Editing by Task-Specific Instruction Tuningcited by 67
- 2023RewriteLM: An Instruction-Tuned Large Language Model for Text Rewritingcited by 67
12 most cited of 194 All 194 (JSON)
- 2026FAVoR: Measuring and Mitigating Author-Style Homogenization in Federated Personalized Generation25 Sep 2026
- 2026Evaluating Communicative Success in Machine-Translated Conversation17 Sep 2026
- 2026Can Activation Steering Capture Multidimensional Authorship Style?4 Sep 2026
- 2026PragAlign: Evidence-Sensitive Reply Assistance Across Chinese and Japanese Appropriateness Judgments27 Aug 2026
- 2026Do Recipes Have Personas? Characterizing and Generating Creator Style in Attributed Procedural Graphs25 Aug 2026
- 2026Bridging the Usability Gap: Lessons from Interpreting Studies for Machine Interpreting Design14 Jun 2026
- 2026Casual as an Anchor: Resolving Supervision Misalignment in Formality Transfer Dataset28 May 2026
- 2026Learn-To-Learn on Arbitrary Textual Conditioning: A Hypernetwork-Driven Meta-Gated LLM3 May 2026
- 2026Please Make it Sound like Human: Encoder-Decoder vs. Decoder-Only Transformers for AI-to-Human Text Style Transfer13 Apr 2026
- 2026Not My Truce: Personality Differences in AI-Mediated Workplace Negotiation1 Apr 2026
- 2026A Universal Vibe? Finding and Controlling Language-Agnostic Informal Register with SAEs27 Mar 2026
- 2026Answer Bubbles: Information Exposure in AI-Mediated Search17 Mar 2026
12 newest of 194 All 194 (JSON)