Beating the Style Detector: Three Hours of Agentic Research on the AI-Text Arms Race
On the map: LLM agents and tool use → Social simulation and multi-agent debate
Abstract (arXiv)
Reproducing an empirical NLP study used to take weeks. Given the released data and a modern agentic-research harness, we redo every experiment of a recent ACL,2026 study on personal-style post-editing of LLM drafts -- and add three new ones -- with the human investigator acting only as a reviewer-in-the-loop. We reproduce all seven preregistered hypotheses and recover the paper's headline correlation between perceived self-similarity and embedding-measured self-similarity to three decimal places (r=+0.244, p<10-8, n=648). Under a leakage-free held-out protocol, GPT-5.5 and Claude,Opus,4.7 close 71--75,% of the style gap to the same-author ceiling on 324 paired tasks, against 24,% for the human post-edit, and beat the human post-edit on ~80,% of tasks. We then frame the same data as an AI-text detection arms race. A leave-authors-out linear SVM on LUAR-MUD embeddings reaches AUC 0.93--1.00 across approaches; six diagnostics show that GPT-5.5 detection is mostly a length confound while Opus detection is a genuine stylistic signature. Given T=20 feedback iterations against the frozen detector, an Opus agent flips two of five held-out test mimics to the human half-space and shrinks every margin by an order of magnitude. With moderate effort against a known detector, a frontier LLM can already efficiently lower its own AI-detection probability. All code, 648 mimic drafts, trained detectors, diagnostics, and adversarial trajectories are released.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 4 of its 12 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
4 of 12 references.
References · 4
- 2018A Gentle Introduction to Deep Learning in Medical Image Processingcited by 34
- 2021Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Futurecited by 18
- 2017Precision Learning: Towards Use of Known Operators in Neural Networkscited by 7
- 2026Can You Make It Sound Like You? Post-Editing LLM-Generated Text for Personal Stylecited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Edits
- 2026Measuring, Localizing, and Ablating Alignment Signatures in LLMs
- 2026A Concise Agent is Less Expert: Revealing Side Effects of Using Style Features on Conversational Agents
- 2024Investigating Wit, Creativity, and Detectability of Large Language Models in Domain-Specific Writing Style Adaptation of Reddit's Showerthoughts
- 2024Detecting Mode Collapse in Language Models via Narration
- 2024Imitate Before Detect: Aligning Machine Stylistic Preference for Machine-Revised Text Detection
- 2025Beyond Words: Infusing Conversational Agents with Human-like Typing Behaviors
- 2026From Context Shift to Stylistic Collapse: Why Training Objectives Matter More Than Scale