Linear Probing Provides Robust and Efficient Detection of Machine-Generated Text
On the map: Mechanistic interpretability → Probing deception, bias and beliefs
Abstract (arXiv)
Distinguishing machine-generated text (MGT) from human-written text (HWT) becomes increasingly important due to potential misuse. However, most supervised detectors often degrade out-of-domain (OOD) and require large, diverse training sets. In this work, we analyze the linearity and quality of MGT representations and show that simple linear probes outperform a wide range of detectors while being substantially more sample-efficient. We first show that MGT and HWT latent representations are linearly separable in low-dimensional space, and provide a plausible explanation for this separability through systematic differences in their representation quality. Motivated by these insights, we train two variants of simple linear probes and evaluate them across 4 benchmarks against 16 baselines. Probes consistently improve OOD detection (+11 AUC), requiring solely <100 samples to reach near-peak performance. We show that this transferability arises because probes recover a shared latent MGT direction that generalizes across diverse settings. Finally, we demonstrate that probing vectors capture a continuous spectrum of ``machineness'', highlighting their potential for fine-grained estimation of AI-edited text. Overall, our work provides insights into latent-space differences between MGT and HWT and demonstrates the potential of linear probes as as robust and sample-efficient MGT detectors. We release our code on~hrefhttps://github.com/gerritq/mgtprobesgithub.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Probing deception, bias and beliefs, one of 13 directions in Mechanistic interpretability. Builds on 35 of its 51 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
35 of 51 references.
Closest ancestors · 1
Same direction, newest first
Other references · 34
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2019Release Strategies and the Social Impacts of Language Modelscited by 513
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
22 more
- 2023Emergent Linear Representations in World Models of Self-Supervised Sequence Modelscited by 319
- 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
- 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
- 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
- 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
- 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 158
- 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 129
- 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
- 2024Raidar: geneRative AI Detection viA Rewritingcited by 52
- 2023The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Modelscited by 39
- 2025Refusal Direction is Universal Across Safety-Aligned Languagescited by 38
- 2024Are We in the AI-Generated Text World Already? Quantifying and Monitoring AIGT on Social Mediacited by 35
- 2024Who Wrote This? The Key to Zero-Shot LLM-Generated Text Detection Is GECScorecited by 27
- 2025EditLens: Quantifying the Extent of AI Editing in Textcited by 26
- 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patternscited by 24
- 2025Almost AI, Almost Human: The Challenge of Detecting AI-Polished Writingcited by 19
- 2018Persistent Homology and the Upper Box Dimensioncited by 15
- 2024Exploring the Limitations of Detecting Machine-Generated Textcited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MGT-Prism: Enhancing Domain Generalization for Machine-Generated Text Detection via Spectral Alignment
- 2025Advancing Machine-Generated Text Detection from an Easy to Hard Supervision Perspective
- 2026Detecting the Machine: A Comprehensive Benchmark of AI-Generated Text Detectors Across Architectures, Domains, and Adversarial Conditions
- 2026SV-Detect: AI-generated Text Detection with Steering Vectors
- 2025Feature-Level Insights into Artificial Text Detection with Sparse Autoencoders
- 2025Stress-testing Machine Generated Text Detection: Shifting Language Models Writing Style to Fool Detectors
- 2023AuthentiGPT: Detecting Machine-Generated Text via Black-Box Language Models Denoising
- 2024TextMachina: Seamless Generation of Machine-Generated Text Datasets