mlsanityData to 14 Oct 2026

When Writing Style Drifts: Benchmarking Authorship Verification under Distribution Shifts in Genre, Time and the AI-Era

arXiv 2608.17979 ↗First posted 18 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Authorship verification (AV) assumes that an author's writing style remains sufficiently stable to distinguish it from that of other writers. In practice, however, this assumption is challenged by distribution shifts caused by changes in genre, time, and AI-assisted writing. Existing AV benchmarks typically study these factors in isolation and focus predominantly on English, limiting our understanding of model robustness under realistic conditions. We introduce AVShift, the first German benchmark for systematically evaluating AV under multiple distribution shifts. AVShift comprises over 150,000 text pairs spanning three genres and 21 years, enabling controlled evaluation of cross-genre, temporal, and AI-era shifts within a unified framework. We benchmark representative feature-based, embedding-based, and LLM-based approaches. Our experiments show that fine-tuned LLMs generalize best across genres and benefit substantially from stylistically diverse training data. We further demonstrate that temporal drift is one of the strongest factors affecting AV, with performance degrading significantly as the time gap between documents increases. In contrast, we find no evidence of a measurable AI-era distribution shift within AVShift. Finally, our feature analysis reveals stylistic features that remain stable across genres, while their relative importance varies depending on the specific genre transition. We release AVShift and our code for future research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 54 references that are in the map. First posted on arXiv 18 Aug 2026.

Builds on

13 of 54 references.

References · 13

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  4. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
  5. 2021Theoretical Foundations of t-SNE for Visualizing High-Dimensional Clustered Datacited by 55
  6. 2019Explainable Authorship Verification in Social Media via Attention-based Similarity Learningcited by 37
  7. 2025Prototypical Human-AI Collaboration Behaviors from LLM-Assisted Writing in the Wildcited by 25
  8. 2022VeriDark: A Large-Scale Benchmark for Authorship Verification on the Dark Webcited by 10
  9. 2025Leveraging Multilingual Training for Authorship Representation: Enhancing Generalization across Languages and Domainscited by 8
  10. 2020POSNoise: An Effective Countermeasure Against Topic Biases in Authorship Analysiscited by 7
  11. 2024InstructAV: Instruction Fine-tuning Large Language Models for Authorship Verificationcited by 4
  12. 2025Residualized Similarity for Faithfully Explainable Authorship Verificationcited by 4
1 more
  1. 2026GerAV: Towards New Heights in German Authorship Verification using Fine-Tuned LLMs on a New Benchmarkcited by 1

Built on by

Not cited yet.