Beyond checkmate: exploring the creative chokepoints in AI text
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of Large Language Models (LLMs) has revolutionized text generation but also raised concerns about potential misuse, making detecting LLM-generated text (AI text) increasingly essential. While prior work has focused on identifying AI text and effectively checkmating it, our study investigates a less-explored territory: portraying the nuanced distinctions between human and AI texts across text segments (introduction, body, and conclusion). Whether LLMs excel or falter in incorporating linguistic ingenuity across text segments, the results will critically inform their viability and boundaries as effective creative assistants to humans. Through an analogy with the structure of chess games, comprising opening, middle, and end games, we analyze segment-specific patterns to reveal where the most striking differences lie. Although AI texts closely resemble human writing in the body segment due to its length, deeper analysis shows a higher divergence in features dependent on the continuous flow of language, making it the most informative segment for detection. Additionally, human texts exhibit greater stylistic variation across segments, offering a new lens for distinguishing them from AI. Overall, our findings provide fresh insights into human-AI text differences and pave the way for more effective and interpretable detection strategies. Codes available at https://github.com/tripto03/chess_inspired_human_ai_text_distinction.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 28 of its 86 references that are in the map. First posted on arXiv 31 Jan 2025.
Builds on
28 of 86 references.
References · 28
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2019Defending Against Neural Fake Newscited by 553
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
- 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 187
- 2023Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?cited by 167
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
- 2023MAGE: Machine-generated Text Detection in the Wildcited by 130
16 more
- 2020Aligning Superhuman AI with Human Behavior: Chess as a Model Systemcited by 78
- 2023Contrasting Linguistic Patterns in Human and LLM-Generated News Textcited by 62
- 2024Do LLMs write like humans? Variation in grammatical and rhetorical stylescited by 62
- 2024Authorship Attribution in the Era of LLMs: Problems, Methodologies, and Challengescited by 46
- 2023GPT-who: An Information Density-based Machine-Generated Text Detectorcited by 38
- 2022On the State of the Art in Authorship Attribution and Authorship Verificationcited by 27
- 2023Don't lose the message while paraphrasing: A study on content preserving style transfercited by 25
- 2022Detecting Individual Decision-Making Style: Exploring Behavioral Stylometry in Chesscited by 18
- 2024Explore the Reasoning Capability of LLMs in the Chess Testbedcited by 17
- 2023Large language models can segment narrative events similarly to humanscited by 16
- 2024Can Large Language Models Play Games? A Case Study of A Self-Play Approachcited by 12
- 2020Structural Text Segmentation of Legal Documentscited by 11
- 2023HANSEN: Human and AI Spoken Text Benchmark for Authorship Analysiscited by 10
- 2024Whose LLM is it Anyway? Linguistic Comparison and LLM Attribution for GPT-3.5, GPT-4 and Bardcited by 10
- 2024Checkmating One, by Using Many: Combining Mixture of Experts with MCTS to Improve in Chesscited by 4
- 2022Assessing the Impact of Sequence Length Learning on Classification Tasks for Transformer Encoder Modelscited by 3
Built on by
Citing papers per year: 2025: 2.
2 papers.