The Last Fingerprint: How Markdown Training Shapes LLM Prose
Not on the map. Why?
Abstract (arXiv)
Large language models produce em dashes at varying rates, and the observation that some models "overuse" them has become one of the most widely discussed markers of AI-generated text. Yet no mechanistic account of this pattern exists, and the parallel observation that LLMs default to markdown-formatted output has never been connected to it. We propose that the em dash is markdown leaking into prose -- the smallest surviving unit of the structural orientation that LLMs acquire from markdown-saturated training corpora. We present a five-step genealogy connecting training data composition, structural internalization, the dual-register status of the em dash, and post-training amplification. We test this with a two-condition suppression experiment across twelve models from five providers (Anthropic, OpenAI, Meta, Google, DeepSeek): when models are instructed to avoid markdown formatting, overt features (headers, bullets, bold) are eliminated or nearly eliminated, but em dashes persist -- except in Meta's Llama models, which produce none at all. Em dash frequency and suppression resistance vary from 0.0 per 1,000 words (Llama) to 9.1 (GPT-4.1 under suppression), functioning as a signature of the specific fine-tuning procedure applied. A three-condition suppression gradient shows that even explicit em dash prohibition fails to eliminate the artifact in some models, and a base-vs-instruct comparison confirms that the latent tendency exists pre-RLHF. These findings connect two previously isolated online discourses and reframe em dash frequency as a diagnostic of fine-tuning methodology rather than a stylistic defect.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
16 of 24 references.
References · 16
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2023A Watermark for Large Language Modelscited by 667
4 more
- 2021Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpuscited by 481
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
- 2023GPT detectors are biased against non-native English writerscited by 175
- 2023The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AIcited by 73
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026From Context Shift to Stylistic Collapse: Why Training Objectives Matter More Than Scale
- 2026Break Step: Recursive Training Resonates with Replayed Sampling Noise
- 2026The Text Uncanny Valley: Non-Monotonic Performance Degradation in LLM Information Retrieval
- 2026Measuring, Localizing, and Ablating Alignment Signatures in LLMs
- 2025SR-LLM: Rethinking the Structured Representation in Large Language Model
- 2026Self-Training Doesn't Flatten Language -- It Restructures It: Surface Markers Amplify While Deep Syntax Dies
- 2026Investigating Linguistic Steering: An Analysis of Adjectival Effects Across Large Language Model Architectures
- 2025Conversational Speech Reveals Structural Robustness Failures in SpeechLLM Backbones