Scaling Long-Form Story Generation via Narrative State Tracking
Not on the map. Why?
Abstract (arXiv)
LLMs have demonstrated strong capabilities in creative writing. However, scaling them to full-length novels remains challenging, as maintaining narrative consistency becomes increasingly difficult. Existing story-generation methods typically focus on stories of up to about ten thousand words, leaving their ability to scale to full-length novels underexplored. In this work, we introduce Narrative State Tracking Agent (NstAgent), a training-free agentic framework that allows LLMs to track a structured narrative state including characters, past events and future requirements. We extend an existing benchmark to compare narrative consistency across lengths, and use it together with a writing-quality benchmark to systematically evaluate stories ranging from 10K to 100K words. We show that NstAgent achieves better narrative consistency and writing quality as stories grow longer, and neither of them degrades noticeably as length increases, suggesting that it provides an effective approach to scaling story generation toward full-length novels.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 63 of its 77 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
63 of 77 references.
References · 63
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2018Hierarchical Neural Story Generationcited by 1,182
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
38 more
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
- 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
- 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 232
- 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
- 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
- 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 142
- 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
- 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 104
- 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 95
- 2023RecurrentGPT: Interactive Generation of (Arbitrarily) Long Textcited by 84
- 2022Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generationcited by 73
- 2021OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metricscited by 61
- 2018Modeling Naive Psychology of Characters in Simple Commonsense Storiescited by 59
- 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
- 2024LongGenBench: Benchmarking Long-Form Generation in Long Context LLMscited by 47
- 2025LitBench: A Benchmark and Dataset for Reliable Evaluation of Creative Writingcited by 39
- 2024Do Language Models Enjoy Their Own Stories? Prompting Large Language Models for Automatic Story Evaluationcited by 32
- 2024Generating Long-form Story Using Dynamic Hierarchical Outlining with Memory-Enhancementcited by 30
- 2024CollabStory: Multi-LLM Collaborative Story Generation and Authorship Analysiscited by 26
- 2024Language Models can Self-Lengthen to Generate Long Textscited by 24
- 2025Finding Flawed Fictions: Evaluating Complex Reasoning in Language Models via Plot Hole Detectioncited by 24
- 2024Creating Suspenseful Stories: Iterative Planning with Large Language Modelscited by 22
- 2023Improving Pacing in Long-Form Story Planningcited by 21
- 2024Collective Critics for Creative Story Generationcited by 21
- 2025StoryWriter: A Multi-Agent Framework for Long Story Generationcited by 19
- 2025Beyond Outlining: Heterogeneous Recursive Planning for Adaptive Long-form Writing with Language Modelscited by 15
- 2025LongWriter-Zero: Mastering Ultra-Long Text Generation via Reinforcement Learningcited by 13
- 2024Ex3: Automatic Novel Writing by Extracting, Excelsior and Expandingcited by 10
- 2025Help Me Write a Story: Evaluating LLMs' Ability to Generate Writing Feedbackcited by 10
- 2024CHIRON: Rich Character Representations in Long-Form Narrativescited by 9
- 2025STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generationcited by 9
- 2024SWAG: Storytelling With Action Guidancecited by 8
- 2025Frankentext: Stitching random text fragments into long-form narrativescited by 8
- 2025Spotting Out-of-Character Behavior: Atomic-Level Evaluation of Persona Fidelity in Open-Ended Generationcited by 8
- 2024FACTTRACK: Time-Aware World State Tracking in Story Outlinescited by 6
- 2026Lost in Stories: Consistency Bugs in Long Story Generation by LLMscited by 6
- 2025SuperWriter: Reflection-Driven Long-Form Generation with Large Language Modelscited by 5
- 2025What Matters in Evaluating Book-Length Stories? A Systematic Study of Long Story Evaluationcited by 5
50 most cited of 63 All 63 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026From Personas to Plot: Character-Grounded Multi-Agent Story Generation for Long-Form Narratives
- 2026Shared Worlds, Private Minds: Structured Memory for Long-Form Writing as World Creation
- 2025CreAgentive: An Agent Workflow Driven Multi-Category Creative Generation Engine
- 2025NexusSum: Hierarchical LLM Agents for Long-Form Narrative Summarization
- 2025SCORE: Story Coherence and Retrieval Enhancement for AI Narratives
- 2026NARRA-Gym for Evaluating Interactive Narrative Agents
- 2026When Stories Evolve: Benchmarking LLM Storytelling Across Agent Architectures in Open-Ended World Simulations
- 2025Plug-and-Play Dramaturge: A Divide-and-Conquer Approach for Iterative Narrative Script Refinement via Collaborative LLM Agents