MultiGhostBench: A Multilingual Benchmark for Long-Form LLM-Generated Text Attribution under Distribution Shifts
Not on the map. Why?
Abstract (arXiv)
While existing work on LLM authorship attribution (AA) has made progress, available benchmarks remain limited, often focusing on English, controlled settings, or relatively outdated models, with the few multilingual studies considering only relatively short texts. We introduce MultiGhostBench, a multilingual benchmark comprising 928 books generated by five recent LLMs across six languages and three scripts, with an average length of approximately 59K words per book. The benchmark supports evaluation under domain, author, and language shifts. Evaluation of representative AA methods shows that no single method consistently performs best across settings, and performance generally degrades under distribution shifts. Transformer-based detectors can retain generator-related information across languages, although transfer effectiveness varies by language pair, whereas statistical and fingerprint-based detectors are more language-dependent. We envision MultiGhostBench as a valuable resource for the development and evaluation of robust AA methods. The dataset and code can be found at https://github.com/GrecoMT/MultiGhostBench.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 51 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
31 of 51 references.
References · 31
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
- 2018Texygen: A Benchmarking Platform for Text Generation Modelscited by 491
- 2023MEGA: Multilingual Evaluation of Generative AIcited by 293
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2020German's Next Language Modelcited by 144
- 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 129
- 2021TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text Generationcited by 120
19 more
- 2019Adaptation of Deep Bidirectional Multilingual Transformers for Russian Languagecited by 109
- 2022Human heuristics for AI-generated language are flawedcited by 105
- 2023Spanish Pre-trained BERT Model and Evaluation Datacited by 81
- 2022Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generationcited by 75
- 2024Pangea: A Fully Open Multilingual Multimodal LLM for 39 Languagescited by 64
- 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learningcited by 53
- 2024Standardizing the Measurement of Text Diversity: A Tool and a Comparative Analysis of Scorescited by 50
- 2021A Primer on Pretrained Multilingual Language Modelscited by 49
- 2024Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challengescited by 47
- 2025EditLens: Quantifying the Extent of AI Editing in Textcited by 26
- 2020Summarize, Outline, and Elaborate: Long-Text Generation via Hierarchical Supervision from Extractive Summariescited by 19
- 2024Navigating the Path of Writing: Outline-guided Text Generation with Large Language Modelscited by 15
- 2022Self-Repetition in Abstractive Neural Summarizerscited by 13
- 2025AI use in American newspapers is widespread, uneven, and rarely disclosedcited by 10
- 2025OpenTuringBench: An Open-Model-based Benchmark and Framework for Machine-Generated Text Detection and Attributioncited by 9
- 2025Authorship Attribution in Multilingual Machine-Generated Textscited by 8
- 2024Towards Reliable Detection of LLM-Generated Texts: A Comprehensive Evaluation Framework with CUDRTcited by 3
- 2025CEAID: Benchmark of Multilingual Machine-Generated Text Detection Methods for Central European Languagescited by 2
- 2026Who Wrote the Book? Detecting and Attributing LLM Ghostwriterscited by 2
Built on by
Not cited yet.