mlsanityData to 14 Oct 2026

Linear Probing Provides Robust and Efficient Detection of Machine-Generated Text

arXiv 2608.24780 ↗First posted 25 Aug 2026cs.CLcited by 0

On the map: Mechanistic interpretability → Probing deception, bias and beliefs

Abstract (arXiv)

Distinguishing machine-generated text (MGT) from human-written text (HWT) becomes increasingly important due to potential misuse. However, most supervised detectors often degrade out-of-domain (OOD) and require large, diverse training sets. In this work, we analyze the linearity and quality of MGT representations and show that simple linear probes outperform a wide range of detectors while being substantially more sample-efficient. We first show that MGT and HWT latent representations are linearly separable in low-dimensional space, and provide a plausible explanation for this separability through systematic differences in their representation quality. Motivated by these insights, we train two variants of simple linear probes and evaluate them across 4 benchmarks against 16 baselines. Probes consistently improve OOD detection (+11 AUC), requiring solely <100 samples to reach near-peak performance. We show that this transferability arises because probes recover a shared latent MGT direction that generalizes across diverse settings. Finally, we demonstrate that probing vectors capture a continuous spectrum of ``machineness'', highlighting their potential for fine-grained estimation of AI-edited text. Overall, our work provides insights into latent-space differences between MGT and HWT and demonstrates the potential of linear probes as as robust and sample-efficient MGT detectors. We release our code on~hrefhttps://github.com/gerritq/mgtprobesgithub.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Probing deception, bias and beliefs, one of 13 directions in Mechanistic interpretability. Builds on 35 of its 51 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

35 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Linear Probe Accuracy Scales with Model Size and Benefits from Multi-Layer Ensembling15 Apr

Other references · 34

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  4. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  5. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
  6. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
  7. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  8. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  9. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  10. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
  11. 2019Release Strategies and the Social Impacts of Language Modelscited by 513
  12. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
22 more
  1. 2023Emergent Linear Representations in World Models of Self-Supervised Sequence Modelscited by 319
  2. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
  3. 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 287
  4. 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 263
  5. 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
  6. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 210
  7. 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 190
  8. 2024Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviewscited by 164
  9. 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 163
  10. 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 158
  11. 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 129
  12. 2023Intrinsic Dimension Estimation for Robust Detection of AI-Generated Textscited by 112
  13. 2024Raidar: geneRative AI Detection viA Rewritingcited by 52
  14. 2023The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Modelscited by 39
  15. 2025Refusal Direction is Universal Across Safety-Aligned Languagescited by 38
  16. 2024Are We in the AI-Generated Text World Already? Quantifying and Monitoring AIGT on Social Mediacited by 35
  17. 2024Who Wrote This? The Key to Zero-Shot LLM-Generated Text Detection Is GECScorecited by 27
  18. 2025EditLens: Quantifying the Extent of AI Editing in Textcited by 26
  19. 2025RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patternscited by 24
  20. 2025Almost AI, Almost Human: The Challenge of Detecting AI-Polished Writingcited by 19
  21. 2018Persistent Homology and the Upper Box Dimensioncited by 15
  22. 2024Exploring the Limitations of Detecting Machine-Generated Textcited by 15

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MGT-Prism: Enhancing Domain Generalization for Machine-Generated Text Detection via Spectral Alignment
  2. 2025Advancing Machine-Generated Text Detection from an Easy to Hard Supervision Perspective
  3. 2026Detecting the Machine: A Comprehensive Benchmark of AI-Generated Text Detectors Across Architectures, Domains, and Adversarial Conditions
  4. 2026SV-Detect: AI-generated Text Detection with Steering Vectors
  5. 2025Feature-Level Insights into Artificial Text Detection with Sparse Autoencoders
  6. 2025Stress-testing Machine Generated Text Detection: Shifting Language Models Writing Style to Fool Detectors
  7. 2023AuthentiGPT: Detecting Machine-Generated Text via Black-Box Language Models Denoising
  8. 2024TextMachina: Seamless Generation of Machine-Generated Text Datasets