Capturing Classic Authorial Style in Long-Form Story Generation with GRPO Fine-Tuning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
also in 1 more
Abstract (arXiv)
Evaluating and optimising authorial style in long-form story generation remains challenging because style is often assessed with ad hoc prompting and is frequently conflated with overall writing quality. We propose a two-stage pipeline. First, we train a dedicated style-similarity judge by fine-tuning a sentence-transformer with authorship-verification supervision, and calibrate its similarity outputs into a bounded [0,1] reward. Second, we use this judge as the primary reward in Group Relative Policy Optimization (GRPO) to fine-tune an 8B story generator for style-conditioned writing, avoiding the accept/reject supervision required by Direct Preference Optimization (DPO). Across four target authors (Mark Twain, Jane Austen, Charles Dickens, Thomas Hardy), the GRPO-trained 8B model achieves higher style scores than open-weight baselines, with an average style score of 0.893 across authors. These results suggest that AV-calibrated reward modelling provides a practical mechanism for controllable style transfer in long-form generation under a moderate model size and training budget.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 20 of its 40 references that are in the map. First posted on arXiv 5 Dec 2025.
Builds on
20 of 40 references.
References · 20
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
- 2023OpenChat: Advancing Open-source Language Models with Mixed-Quality Datacited by 252
- 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 144
- 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 106
8 more
- 2023EQ-Bench: An Emotional Intelligence Benchmark for Large Language Modelscited by 80
- 2025LitBench: A Benchmark and Dataset for Reliable Evaluation of Creative Writingcited by 42
- 2024StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examplescited by 35
- 2023Who Wrote it and Why? Prompting Large-Language Models for Authorship Verificationcited by 19
- 2023Can Authorship Representation Learning Capture Stylistic Features?cited by 17
- 2024Distinguishing Fictional Voices: a Study of Authorship Verification Models for Quotation Attributioncited by 4
- 2022Great Expectations: Unsupervised Inference of Suspense, Surprise and Salience in Storytellingcited by 3
- 2024Addressing Topic Leakage in Cross-Topic Evaluation for Authorship Verificationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer
- 2026POLARIS: Guiding Small Models to Write Long Stories
- 2026AuthorMix: Modular Authorship Style Transfer via Layer-wise Adapter Mixing
- 2026Towards Human-Level Book-Writing Capability
- 2025DocReward: A Document Reward Model for Structuring and Stylizing
- 2026StoryLens: Preference-Aligned Story Rewriting via Context-Aware Narrative Enrichment
- 2025Semantically-Aware Rewards for Open-Ended R1 Training in Free-Form Generation
- 2024SAG: Style-Aligned Article Generation via Model Collaboration