mlsanityData to 7 Oct 2026

AuthorMix: Modular Authorship Style Transfer via Layer-wise Adapter Mixing

arXiv 2603.23069 ↗First posted 24 Mar 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The task of authorship style transfer involves rewriting text in the style of a target author while preserving the meaning of the original text. Existing style transfer methods train a single model on large corpora to model all target styles at once: this high-cost approach offers limited flexibility for target-specific adaptation, and often sacrifices meaning preservation for style transfer. In this paper, we propose AuthorMix: a lightweight, modular, and interpretable style transfer framework. We first train individual, style-specific LoRA adapters on a small set of high-resource authors: this allows for the rapid training of specialized adaptation models for each new target using layer-wise adapter mixing via reinforcement learning, necessitating only a handful of target-style training examples. AuthorMix ranks first on the combined style-meaning score among all baselines, including GPT-5.1, and substantially improves meaning preservation over the trained baselines; under human evaluation it is the only method best-or-tied on every dimension.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 46 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

28 of 46 references.

References · 28

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  5. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
  6. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  7. 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 994
  8. 2018Neural Network Acceptability Judgmentscited by 952
  9. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
  10. 2020AdapterFusion: Non-Destructive Task Composition for Transfer Learningcited by 780
  11. 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 359
  12. 2020Reformulating Unsupervised Style Transfer as Paraphrase Generationcited by 181
16 more
  1. 2020Deep Learning for Text Style Transfer: A Surveycited by 161
  2. 2023AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Modelscited by 84
  3. 2022Same Author or Just Same Topic? Towards Content-Independent Style Representationscited by 83
  4. 2018A standardized Project Gutenberg corpus for statistical analysis of natural language and quantitative linguisticscited by 64
  5. 2024LoRA Soups: Merging LoRAs for Practical Skill Composition Taskscited by 49
  6. 2021A Closer Look at How Fine-tuning Changes BERTcited by 42
  7. 2020TextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restylingcited by 39
  8. 2024StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examplescited by 32
  9. 2026How LLMs Distort Our Written Languagecited by 20
  10. 2023ParaGuide: Guided Diffusion Paraphrasers for Plug-and-Play Textual Style Transfercited by 18
  11. 2024StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elementscited by 18
  12. 2021Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representationscited by 16
  13. 2024TinyStyler: Efficient Few-Shot Text Style Transfer with Authorship Embeddingscited by 16
  14. 2023Understanding writing style in social media with a supervised contrastively pre-trained transformercited by 11
  15. 2022Low-Resource Authorship Style Transfer: Can Non-Famous Authors Be Imitated?cited by 9
  16. 2024Customizing Large Language Model Generation Style using Parameter-Efficient Finetuningcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.