Multi-Level Contextual Token Relation Modeling for Machine-Generated Text Detection
Not on the map. Why?
Abstract (arXiv)
Machine-generated texts (MGTs) pose risks such as disinformation and phishing, underscoring the need for reliable detection. Metric-based methods, which extract statistically distinguishable features of MGTs, are often more practical than complex model-based methods that are prone to overfitting. Given their diverse designs, we first place representative metric-based methods within a unified framework, enabling a clear assessment of their advantages and limitations. Our analysis identifies a core challenge across these methods: the token-level detection score is easily biased by the inherent randomness of the MGTs generation process. Then, we theoretically derive the multi-hop transitions of the token-level detection score and explore their local and global relations. Based on these findings, we propose a multi-level contextual token relation modeling framework for MGT detection. Specifically, for local relations, we model them through a lightweight Markov-informed calibration module that refines token-level evidence before aggregation. For global relations, we introduce a rule-support reasoning module that uses explicit logical rules derived from contextual score statistics. Finally, we combine the local calibrated score and the global rule-support reasoning signal in a joint multi-level inference framework. Extensive experiments show broad and substantial improvements across various real-world scenarios, including cross-LLM and cross-domain settings, with low computational overhead.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 53 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
41 of 53 references.
References · 41
- 2023GPT-4 Technical Reportcited by 18,396
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2023A Watermark for Large Language Modelscited by 725
- 2019Release Strategies and the Social Impacts of Language Modelscited by 513
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
- 2023Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Timecited by 439
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
- 2023Can AI-Generated Text be Reliably Detected?cited by 386
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
29 more
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
- 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
- 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 129
- 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
- 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
- 2023REMARK-LLM: A Robust and Efficient Watermarking Framework for Generative Large Language Modelscited by 78
- 2024Adaptive Text Watermark for Large Language Modelscited by 67
- 2023Multiscale Positive-Unlabeled Detection of AI-Generated Textscited by 61
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
- 2023A Resilient and Accessible Distribution-Preserving Watermark for Large Language Modelscited by 56
- 2023SeqXGPT: Sentence-Level AI-Generated Text Detectioncited by 56
- 2023LLMDet: A Third Party Large Language Models Generated Text Detection Toolcited by 45
- 2024DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarioscited by 38
- 2024Training-free LLM-generated Text Detection by Mining Token Probability Sequencescited by 35
- 2022CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Data Limitation With Contrastive Learningcited by 33
- 2023Disinformation Capabilities of Large Language Modelscited by 25
- 2023Zero-Shot Detection of Machine-Generated Codescited by 24
- 2024Detecting Subtle Differences between Human and Model Languages Using Spectrum of Relative Likelihoodcited by 24
- 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patternscited by 24
- 2025AdaDetectGPT: Adaptive Detection of LLM-Generated Text with Statistical Guaranteescited by 21
- 2023G3Detector: General GPT-Generated Text Detectorcited by 17
- 2024Zero-Shot Detection of LLM-Generated Text using Token Cohesivenesscited by 13
- 2025DETree: DEtecting Human-AI Collaborative Texts via Tree-Structured Hierarchical Representation Learningcited by 12
- 2022Bayesian Image Super-Resolution with Deep Modeling of Image Statisticscited by 11
- 2025DNA-DetectLLM: Unveiling AI-Generated Text via a DNA-Inspired Mutation-Repair Paradigmcited by 11
- 2025MoSEs: Uncertainty-Aware AI-Generated Text Detection via Mixture of Stylistics Experts with Conditional Thresholdscited by 9
- 2025Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detectioncited by 8
- 2026Learn-to-Distance: Distance Learning for Detecting LLM-Generated Textcited by 8
- 2026Beyond Raw Detection Scores: Markov-Informed Calibration for Boosting Machine-Generated Text Detectioncited by 2
Built on by
Not cited yet.