Scaling Creative Writing Beyond Story-Centric Data with Attribute-Guided Genre Expansion
Not on the map. Why?
Abstract (arXiv)
High-quality creative writing data for large language models (LLMs) remains dominated by story-centric data, limiting models' ability to follow the structural and functional conventions of diverse creative formats. We propose an attribute-guided genre expansion framework for scaling creative writing data beyond story generation. By separating thematic breadth from genre-form control, our framework leverages human-authored story prompts as diverse creative seeds, while utilizing manually curated genre attributes to enforce distinct structural, stylistic, and formatting conventions. We combine these to prompt strong LLMs for genre-faithful query-response pairs, which are then quality-filtered. Applying this framework, we construct the Multi-Genre Collection, a 50K-example corpus spanning 13 creative genres, including story, rap, lyrics, scripts, game design, character design, and other creative formats. Experiments across out-of-distribution writing benchmarks and held-out genre diagnostics demonstrate that models fine-tuned on our data consistently surpass not only base models and writing-specialized baselines, but also models trained on existing writing corpora. Genre-count ablations further indicate that controlled genre expansion, rather than story-centric scaling alone, is a key driver of robust creative writing capability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 27 references that are in the map. First posted on arXiv 14 Aug 2026.
Builds on
16 of 27 references.
References · 16
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
- 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 417
- 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 256
- 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
- 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 144
- 2024OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Datasetcited by 143
- 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 106
4 more
- 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 105
- 2024EXAONE 3.5: Series of Large Language Models for Real-world Use Casescited by 53
- 2025LitBench: A Benchmark and Dataset for Reliable Evaluation of Creative Writingcited by 42
- 2025Reverse-Engineered Reasoning for Open-Ended Generationcited by 32
Built on by
Not cited yet.