Authorship Style Transfer with Policy Optimization
Not on the map. Why?
Abstract (arXiv)
Authorship style transfer aims to rewrite a given text into a specified target while preserving the original meaning in the source. Existing approaches rely on the availability of a large number of target style exemplars for model training. However, these overlook cases where a limited number of target style examples are available. The development of parameter-efficient transfer learning techniques and policy optimization (PO) approaches suggest lightweight PO is a feasible approach to low-resource style transfer. In this work, we propose a simple two-stage tune-and-optimize technique for low-resource textual style transfer. We apply our technique to authorship transfer as well as a larger-data native language style task and in both cases find it outperforms state-of-the-art baseline models.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 32 of its 43 references that are in the map. First posted on arXiv 12 Mar 2024.
Builds on
32 of 43 references.
References · 32
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
- 2018Universal Sentence Encodercited by 485
- 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 434
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 390
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
- 2020The Pushshift Reddit Datasetcited by 289
- 2023Preference Ranking Optimization for Human Alignmentcited by 283
- 2022Quark: Controllable Text Generation with Reinforced Unlearningcited by 236
20 more
- 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 209
- 2019TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agentscited by 188
- 2020Reformulating Unsupervised Style Transfer as Paraphrase Generationcited by 181
- 2019Style Transformer: Unpaired Text Style Transfer without Disentangled Latent Representationcited by 84
- 2019Beyond BLEU: Training Neural Machine Translation with Semantic Similaritycited by 84
- 2020Politeness Transfer: A Tag and Generate Approachcited by 78
- 2023CoEdIT: Text Editing by Task-Specific Instruction Tuningcited by 67
- 2022Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Modelscited by 49
- 2020Hooks in the Headline: Learning to Generate Headlines with Controlled Stylescited by 46
- 2021Keep it Simple: Unsupervised Simplification of Multi-Paragraph Textcited by 45
- 2022Rainier: Reinforced Knowledge Introspector for Commonsense Question Answeringcited by 43
- 2021LEWIS: Levenshtein Editing for Unsupervised Text Style Transfercited by 40
- 2020TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restylingcited by 39
- 2019Reinforcement Learning Based Text Style Transfer without Parallel Training Corpuscited by 38
- 2020On Learning Text Style Transfer with Direct Rewardscited by 24
- 2021A Deep Metric Learning Approach to Account Linkingcited by 24
- 2019Revision in Continuous Space: Unsupervised Text Style Transfer without Adversarial Learningcited by 21
- 2022Improving Iterative Text Revision by Learning Where to Edit from Other Revision Taskscited by 20
- 2023STEER: Unified Style Transfer with Expert Reinforcementcited by 14
- 2022Low-Resource Authorship Style Transfer: Can Non-Famous Authors Be Imitated?cited by 9
Built on by
Citing papers per year: 2024: 4; 2025: 5; 2026: 2.
11 papers.
- 2024Aligning Language Models with Demonstrated Feedbackcited by 32
- 2024StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examplescited by 32
- 2025Leveraging Multilingual Training for Authorship Representation: Enhancing Generalization across Languages and Domainscited by 7
- 2024TAROT: Task-Oriented Authorship Obfuscation Using Policy Optimization Methodscited by 5
- 2024Style Transfer with Multi-iteration Preference Optimizationcited by 4
- 2025SynthDetoxM: Modern LLMs are Few-Shot Parallel Detoxification Data Annotatorscited by 4
- 2025Tuning-Free Personalized Alignment via Trial-Error-Explain In-Context Learningcited by 4
- 2025Evaluating Style-Personalized Text Generation: Challenges and Directionscited by 2
- 2025Attacks on Machine-Text Detectors Retain Stylistic Fingerprintscited by 0
- 2026On the Indistinguishability of Human v/s AI Generated Textcited by 0
- 2026HyperStyler: Low-resource Authorship Style Transfer via Context-aware Style Navigation and Hypernetworkscited by 0
- 2026HyperStyler: Low-resource Authorship Style Transfer via Context-aware Style Navigation and Hypernetworks2 Sep 2026
- 2026On the Indistinguishability of Human v/s AI Generated Text27 Aug 2026
- 2025Leveraging Multilingual Training for Authorship Representation: Enhancing Generalization across Languages and Domains20 Sep 2025
- 2025Evaluating Style-Personalized Text Generation: Challenges and Directions8 Aug 2025
- 2025Attacks on Machine-Text Detectors Retain Stylistic Fingerprints20 May 2025
- 2025Tuning-Free Personalized Alignment via Trial-Error-Explain In-Context Learning13 Feb 2025
- 2025SynthDetoxM: Modern LLMs are Few-Shot Parallel Detoxification Data Annotators10 Feb 2025
- 2024StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examples16 Oct 2024
- 2024TAROT: Task-Oriented Authorship Obfuscation Using Policy Optimization Methods31 Jul 2024
- 2024Style Transfer with Multi-iteration Preference Optimization17 Jun 2024
- 2024Aligning Language Models with Demonstrated Feedback2 Jun 2024