AuthorMix: Modular Authorship Style Transfer via Layer-wise Adapter Mixing
Not on the map. Why?
Abstract (arXiv)
The task of authorship style transfer involves rewriting text in the style of a target author while preserving the meaning of the original text. Existing style transfer methods train a single model on large corpora to model all target styles at once: this high-cost approach offers limited flexibility for target-specific adaptation, and often sacrifices meaning preservation for style transfer. In this paper, we propose AuthorMix: a lightweight, modular, and interpretable style transfer framework. We first train individual, style-specific LoRA adapters on a small set of high-resource authors: this allows for the rapid training of specialized adaptation models for each new target using layer-wise adapter mixing via reinforcement learning, necessitating only a handful of target-style training examples. AuthorMix ranks first on the combined style-meaning score among all baselines, including GPT-5.1, and substantially improves meaning preservation over the trained baselines; under human evaluation it is the only method best-or-tied on every dimension.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 46 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
28 of 46 references.
References · 28
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 994
- 2018Neural Network Acceptability Judgmentscited by 952
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
- 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 359
- 2020Reformulating Unsupervised Style Transfer as Paraphrase Generationcited by 181
16 more
- 2020Deep Learning for Text Style Transfer: A Surveycited by 161
- 2023AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Modelscited by 84
- 2022Same Author or Just Same Topic? Towards Content-Independent Style Representationscited by 83
- 2018A standardized Project Gutenberg corpus for statistical analysis of natural language and quantitative linguisticscited by 64
- 2024LoRA Soups: Merging LoRAs for Practical Skill Composition Taskscited by 49
- 2021A Closer Look at How Fine-tuning Changes BERTcited by 42
- 2020TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restylingcited by 39
- 2024StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examplescited by 32
- 2026How LLMs Distort Our Written Languagecited by 20
- 2023ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfercited by 18
- 2024StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elementscited by 18
- 2021Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representationscited by 16
- 2024TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddingscited by 16
- 2023Understanding writing style in social media with a supervised contrastively pre-trained transformercited by 11
- 2022Low-Resource Authorship Style Transfer: Can Non-Famous Authors Be Imitated?cited by 9
- 2024Customizing Large Language Model Generation Style using Parameter-Efficient Finetuningcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.