mlsanityData to 7 Oct 2026

Beating the Style Detector: Three Hours of Agentic Research on the AI-Text Arms Race

arXiv 2605.02620 ↗First posted 4 May 2026cs.CL cs.LGcited by 1

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Reproducing an empirical NLP study used to take weeks. Given the released data and a modern agentic-research harness, we redo every experiment of a recent ACL,2026 study on personal-style post-editing of LLM drafts -- and add three new ones -- with the human investigator acting only as a reviewer-in-the-loop. We reproduce all seven preregistered hypotheses and recover the paper's headline correlation between perceived self-similarity and embedding-measured self-similarity to three decimal places (r=+0.244, p<10-8, n=648). Under a leakage-free held-out protocol, GPT-5.5 and Claude,Opus,4.7 close 71--75,% of the style gap to the same-author ceiling on 324 paired tasks, against 24,% for the human post-edit, and beat the human post-edit on ~80,% of tasks. We then frame the same data as an AI-text detection arms race. A leave-authors-out linear SVM on LUAR-MUD embeddings reaches AUC 0.93--1.00 across approaches; six diagnostics show that GPT-5.5 detection is mostly a length confound while Opus detection is a genuine stylistic signature. Given T=20 feedback iterations against the frozen detector, an Opus agent flips two of five held-out test mimics to the human half-space and shrinks every margin by an order of magnitude. With moderate effort against a known detector, a frontier LLM can already efficiently lower its own AI-detection probability. All code, 648 mimic drafts, trained detectors, diagnostics, and adversarial trajectories are released.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 4 of its 12 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

4 of 12 references.

References · 4

  1. 2018A Gentle Introduction to Deep Learning in Medical Image Processingcited by 34
  2. 2021Known Operator Learning and Hybrid Machine Learning in Medical Imaging -- A Review of the Past, the Present, and the Futurecited by 18
  3. 2017Precision Learning: Towards Use of Known Operators in Neural Networkscited by 7
  4. 2026Can You Make It Sound Like You? Post-Editing LLM-Generated Text for Personal Stylecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Can AI writing be salvaged? Mitigating Idiosyncrasies and Improving Human-AI Alignment in the Writing Process through Edits
  2. 2026Measuring, Localizing, and Ablating Alignment Signatures in LLMs
  3. 2026A Concise Agent is Less Expert: Revealing Side Effects of Using Style Features on Conversational Agents
  4. 2024Investigating Wit, Creativity, and Detectability of Large Language Models in Domain-Specific Writing Style Adaptation of Reddit's Showerthoughts
  5. 2024Detecting Mode Collapse in Language Models via Narration
  6. 2024Imitate Before Detect: Aligning Machine Stylistic Preference for Machine-Revised Text Detection
  7. 2025Beyond Words: Infusing Conversational Agents with Human-like Typing Behaviors
  8. 2026From Context Shift to Stylistic Collapse: Why Training Objectives Matter More Than Scale