Unsupervised Style Representation Learning for AI-Text Detection via Paraphrase Inversion
Not on the map. Why?
Abstract (arXiv)
The rapid development of large language models (LLMs) has raised concerns about misuse such as plagiarism, misinformation, and automated influence operations, motivating the need for robust detectors. Recent work has shown that neural representations of writing style are effective for detection and, crucially, robust to adversarial attacks that defeat most existing detectors. However, current style-based detectors rely on authorship labels for training, and are limited to few-shot inference for detection, requiring in-distribution samples that may not always be available. We learn discriminative style features without authorship labels by training a style encoder to reconstruct human-authored text from its machine-generated paraphrase; freezing a semantic encoder during training biases the style encoder to capture only the non-semantic features needed for reconstruction. We evaluate the learned representations via two detection strategies: a few-shot detector and a zero-shot DeepSVDD-based detector. Across benchmarks, our method matches or outperforms all baselines in the few-shot setting and, in the zero-shot regime, is competitive with fully supervised classifiers on in-distribution test data while generalizing better to unseen LLMs. Beyond detection, the learned representations generalize to unseen tasks, achieving competitive performance on authorship verification and fine-grained style discrimination despite never being trained on either objective.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 46 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
32 of 46 references.
References · 32
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2023A Watermark for Large Language Modelscited by 667
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
- 2023Can AI-Generated Text be Reliably Detected?cited by 372
- 2023Robust Distortion-free Watermarks for Language Modelscited by 279
- 2023Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvaturecited by 278
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
- 2024Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated Textcited by 255
20 more
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
- 2023RADAR: Robust AI-Text Detection via Adversarial Learningcited by 187
- 2020Reformulating Unsupervised Style Transfer as Paraphrase Generationcited by 181
- 2023Can LLM-Generated Misinformation Be Detected?cited by 173
- 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 157
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
- 2023MAGE: Machine-generated Text Detection in the Wildcited by 130
- 2023DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Textcited by 127
- 2022Same Author or Just Same Topic? Towards Content-Independent Style Representationscited by 83
- 2024Do LLMs write like humans? Variation in grammatical and rhetorical stylescited by 62
- 2024Few-Shot Detection of Machine-Generated Text using Style Representationscited by 40
- 2024StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examplescited by 32
- 2021A Deep Metric Learning Approach to Account Linkingcited by 24
- 2021Does It Capture STEL? A Modular, Similarity-based Linguistic Style Evaluation Frameworkcited by 17
- 2023Understanding writing style in social media with a supervised contrastively pre-trained transformercited by 11
- 2025Catch Me If You Can? Not Yet: LLMs Still Struggle to Imitate the Implicit Writing Styles of Everyday Authorscited by 10
- 2024Separating Style from Substance: Enhancing Cross-Genre Authorship Attribution through Data Selection and Presentationcited by 7
- 2025Leveraging Multilingual Training for Authorship Representation: Enhancing Generalization across Languages and Domainscited by 7
- 2024Mitigating Paraphrase Attacks on Machine-Text Detectors via Paraphrase Inversioncited by 4
- 2025Counterfactual Evaluation for Blind Attack Detection in LLM-based Evaluation Systemscited by 3
Built on by
Not cited yet.