mlsanityData to 14 Oct 2026

How Well Do LLMs Imitate Human Writing Style?

arXiv 2509.24930 ↗First posted 29 Sep 2025cs.CL cs.CYcited by 2

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) can generate fluent text, but their ability to replicate the distinctive style of a specific human author remains unclear. We present a fast, training-free framework for authorship verification and style imitation analysis. The method integrates TF-IDF character n-grams with transformer embeddings and classifies text pairs through empirical distance distributions, eliminating the need for supervised training or threshold tuning. It achieves 97.5% accuracy on academic essays and 94.5% in cross-domain evaluation, while reducing training time by 91.8% and memory usage by 59% relative to parameter-based baselines. Using this framework, we evaluate five LLMs from three separate families (Llama, Qwen, Mixtral) across four prompting strategies - zero-shot, one-shot, few-shot, and text completion. Results show that the prompting strategy has a more substantial influence on style fidelity than model size: few-shot prompting yields up to 23.5x higher style-matching accuracy than zero-shot, and completion prompting reaches 99.9% agreement with the original author's style. Crucially, high-fidelity imitation does not imply human-like unpredictability - human essays average a perplexity of 29.5, whereas matched LLM outputs average only 15.2. These findings demonstrate that stylistic fidelity and statistical detectability are separable, establishing a reproducible basis for future work in authorship modeling, detection, and identity-conditioned generation.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 41 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

18 of 41 references.

References · 18

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2024Qwen2.5 Technical Reportcited by 4,942
  4. 2023Qwen Technical Reportcited by 3,344
  5. 2024Mixtral of Expertscited by 1,823
  6. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  7. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  8. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 606
  9. 2023A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directionscited by 105
  10. 2024Can Large Language Models Identify Authorship?cited by 41
  11. 2019Explainable Authorship Verification in Social Media via Attention-based Similarity Learningcited by 37
  12. 2023Who Wrote it and Why? Prompting Large-Language Models for Authorship Verificationcited by 19
6 more
  1. 2014Authorship Attribution through Function Word Adjacency Networkscited by 10
  2. 2019Syntactic Recurrent Neural Network for Authorship Attributioncited by 10
  3. 2024Using Prompts to Guide Large Language Models in Imitating a Real Person's Language Stylecited by 6
  4. 2024InstructAV: Instruction Fine-tuning Large Language Models for Authorship Verificationcited by 4
  5. 2020Writer Identification Using Microblogging Texts for Social Media Forensicscited by 3
  6. 2024Zero-Shot Prompting and Few-Shot Fine-Tuning: Revisiting Document Image Classification Using Large Language Modelscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.