mlsanityData to 14 Oct 2026

Multi-Level Contextual Token Relation Modeling for Machine-Generated Text Detection

arXiv 2605.16107 ↗First posted 15 May 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine-generated texts (MGTs) pose risks such as disinformation and phishing, underscoring the need for reliable detection. Metric-based methods, which extract statistically distinguishable features of MGTs, are often more practical than complex model-based methods that are prone to overfitting. Given their diverse designs, we first place representative metric-based methods within a unified framework, enabling a clear assessment of their advantages and limitations. Our analysis identifies a core challenge across these methods: the token-level detection score is easily biased by the inherent randomness of the MGTs generation process. Then, we theoretically derive the multi-hop transitions of the token-level detection score and explore their local and global relations. Based on these findings, we propose a multi-level contextual token relation modeling framework for MGT detection. Specifically, for local relations, we model them through a lightweight Markov-informed calibration module that refines token-level evidence before aggregation. For global relations, we introduce a rule-support reasoning module that uses explicit logical rules derived from contextual score statistics. Finally, we combine the local calibrated score and the global rule-support reasoning signal in a joint multi-level inference framework. Extensive experiments show broad and substantial improvements across various real-world scenarios, including cross-LLM and cross-domain settings, with low computational overhead.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 53 references that are in the map. First posted on arXiv 15 May 2026.

Builds on

41 of 53 references.

References · 41

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  3. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  4. 2023A Watermark for Large Language Modelscited by 725
  5. 2019Release Strategies and the Social Impacts of Language Modelscited by 513
  6. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
  7. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
  8. 2023Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Timecited by 439
  9. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 429
  10. 2023Can AI-Generated Text be Reliably Detected?cited by 386
  11. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
  12. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
29 more
  1. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
  2. 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
  3. 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 129
  4. 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
  5. 2023Ghostbuster: Detecting Text Ghostwritten by Large Language Modelscited by 91
  6. 2023REMARK-LLM: A Robust and Efficient Watermarking Framework for Generative Large Language Modelscited by 78
  7. 2024Adaptive Text Watermark for Large Language Modelscited by 67
  8. 2023Multiscale Positive-Unlabeled Detection of AI-Generated Textscited by 61
  9. 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
  10. 2023A Resilient and Accessible Distribution-Preserving Watermark for Large Language Modelscited by 56
  11. 2023SeqXGPT: Sentence-Level AI-Generated Text Detectioncited by 56
  12. 2023LLMDet: A Third Party Large Language Models Generated Text Detection Toolcited by 45
  13. 2024DetectRL: Benchmarking LLM-Generated Text Detection in Real-World Scenarioscited by 38
  14. 2024Training-free LLM-generated Text Detection by Mining Token Probability Sequencescited by 35
  15. 2022CoCo: Coherence-Enhanced Machine-Generated Text Detection Under Data Limitation With Contrastive Learningcited by 33
  16. 2023Disinformation Capabilities of Large Language Modelscited by 25
  17. 2023Zero-Shot Detection of Machine-Generated Codescited by 24
  18. 2024Detecting Subtle Differences between Human and Model Languages Using Spectrum of Relative Likelihoodcited by 24
  19. 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patternscited by 24
  20. 2025AdaDetectGPT: Adaptive Detection of LLM-Generated Text with Statistical Guaranteescited by 21
  21. 2023G3Detector: General GPT-Generated Text Detectorcited by 17
  22. 2024Zero-Shot Detection of LLM-Generated Text using Token Cohesivenesscited by 13
  23. 2025DETree: DEtecting Human-AI Collaborative Texts via Tree-Structured Hierarchical Representation Learningcited by 12
  24. 2022Bayesian Image Super-Resolution with Deep Modeling of Image Statisticscited by 11
  25. 2025DNA-DetectLLM: Unveiling AI-Generated Text via a DNA-Inspired Mutation-Repair Paradigmcited by 11
  26. 2025MoSEs: Uncertainty-Aware AI-Generated Text Detection via Mixture of Stylistics Experts with Conditional Thresholdscited by 9
  27. 2025Human Texts Are Outliers: Detecting LLM-generated Texts via Out-of-distribution Detectioncited by 8
  28. 2026Learn-to-Distance: Distance Learning for Detecting LLM-Generated Textcited by 8
  29. 2026Beyond Raw Detection Scores: Markov-Informed Calibration for Boosting Machine-Generated Text Detectioncited by 2

Built on by

Not cited yet.