AuthBench: A Large-Scale Multilingual Benchmark for Authorship Representation across Genres and Lengths
Not on the map. Why?
Abstract (arXiv)
Authorship signals matter in settings where writing style carries identity: digital forensics, plagiarism analysis, account linking, misinformation investigation, and machine-generated text detection. Yet current authorship benchmarks remain fragmented, usually covering only a narrow language set, a single genre, or a limited document-length regime, which makes it difficult to assess whether modern representations truly generalize. We introduce AuthBench, a large-scale multilingual benchmark for authorship representation that is designed to make this evaluation broad, standardized, and realistic. AuthBench contains 428,150 documents written by 153,825 individuals across ten widely used languages, 9 primary genres, 66 fine-grained genres, and four document-length buckets. It supports two complementary tasks: authorship attribution, formulated as same-author retrieval and authorship verification, formulated as same-author binary decision. We benchmark 47 neural models and three non-neural baselines under a unified zero-shot protocol. Results show that authorship representation remains far from solved: the best retrieval model reaches only 0.258 Success@5, while the best verification model achieves 0.076 EER and 0.968 ROC-AUC. The leaderboard also reveals a meaningful task split, with different model families leading retrieval and verification, and large performance differences across languages, genres, and lengths. These findings position AuthBench not only as a new benchmark, but as a diagnostic resource for studying when and why authorship representations succeed or fail. We release AuthBench, its evaluation toolkit, and benchmark data at https://github.com/mao-code/AuthBench and https://huggingface.co/datasets/MaoXun/AuthBench.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 56 references that are in the map. First posted on arXiv 6 Sep 2026.
Builds on
13 of 56 references.
References · 13
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2020The Multilingual Amazon Reviews Corpuscited by 143
- 2024Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challengescited by 47
- 2022On the State of the Art in Authorship Attribution and Authorship Verificationcited by 27
- 2021A Deep Metric Learning Approach to Account Linkingcited by 24
- 2017An Army of Me: Sockpuppets in Online Discussion Communitiescited by 18
- 2024A diverse Multilingual News Headlines Dataset from around the Worldcited by 6
- 2025A Lightweight Approach to Detection of AI-Generated Texts Using Stylometric Featurescited by 5
- 2024AIDBench: A benchmark for evaluating the authorship identification capability of large language modelscited by 4
- 2025Trends and Challenges in Authorship Analysis: A Review of ML, DL, and LLM Approachescited by 3
1 more
- 2022SMAuC -- The Scientific Multi-Authorship Corpuscited by 2
Built on by
Not cited yet.