Atomic Literary Styling: Mechanistic Manipulation of Prose Generation in Neural Language Models
Not on the map. Why?
Abstract (arXiv)
We present a mechanistic analysis of literary style in GPT-2, identifying individual neurons that discriminate between exemplary prose and rigid AI-generated text. Using Herman Melville's Bartleby, the Scrivener as a corpus, we extract activation patterns from 355 million parameters across 32,768 neurons in late layers. We find 27,122 statistically significant discriminative neurons (p < 0.05), with effect sizes up to |d| = 1.4. Through systematic ablation studies, we discover a paradoxical result: while these neurons correlate with literary text during analysis, removing them often improves rather than degrades generated prose quality. Specifically, ablating 50 high-discriminating neurons yields a 25.7% improvement in literary style metrics. This demonstrates a critical gap between observational correlation and causal necessity in neural networks. Our findings challenge the assumption that neurons which activate on desirable inputs will produce those outputs during generation, with implications for mechanistic interpretability research and AI alignment.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 11 of its 23 references that are in the map. First posted on arXiv 19 Oct 2025.
Builds on
11 of 23 references.
References · 11
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
- 2022Toy Models of Superpositioncited by 971
- 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
- 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 248
- 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 225
- 2017Learning to Generate Reviews and Discovering Sentimentcited by 148
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Investigating Wit, Creativity, and Detectability of Large Language Models in Domain-Specific Writing Style Adaptation of Reddit's Showerthoughts
- 2026Beating the Style Detector: Three Hours of Agentic Research on the AI-Text Arms Race
- 2026Compositional Literary Primitives in Instruction-Tuned LLMs: Cross-Architectural SAE Features for Self, Style, and Affect
- 2026Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer
- 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers
- 2026Metaphor Is Not All Attention Needs
- 2026From Context Shift to Stylistic Collapse: Why Training Objectives Matter More Than Scale
- 2025Capturing Classic Authorial Style in Long-Form Story Generation with GRPO Fine-Tuning