mlsanityData to 7 Oct 2026

Scaling Long-Form Story Generation via Narrative State Tracking

arXiv 2609.35759 ↗First posted 28 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

LLMs have demonstrated strong capabilities in creative writing. However, scaling them to full-length novels remains challenging, as maintaining narrative consistency becomes increasingly difficult. Existing story-generation methods typically focus on stories of up to about ten thousand words, leaving their ability to scale to full-length novels underexplored. In this work, we introduce Narrative State Tracking Agent (NstAgent), a training-free agentic framework that allows LLMs to track a structured narrative state including characters, past events and future requirements. We extend an existing benchmark to compare narrative consistency across lengths, and use it together with a writing-quality benchmark to systematically evaluate stories ranging from 10K to 100K words. We show that NstAgent achieves better narrative consistency and writing quality as stories grow longer, and neither of them degrades noticeably as length increases, suggesting that it provides an effective approach to scaling story generation toward full-length novels.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 63 of its 77 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

63 of 77 references.

References · 63

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  6. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  7. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  8. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  9. 2018Hierarchical Neural Story Generationcited by 1,182
  10. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  11. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 651
  12. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
38 more
  1. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  2. 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 367
  3. 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 232
  4. 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
  5. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  6. 2024LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMscited by 142
  7. 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
  8. 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 104
  9. 2025WritingBench: A Comprehensive Benchmark for Generative Writingcited by 95
  10. 2023RecurrentGPT: Interactive Generation of (Arbitrarily) Long Textcited by 84
  11. 2022Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generationcited by 73
  12. 2021OpenMEVA: A Benchmark for Evaluating Open-ended Story Generation Metricscited by 61
  13. 2018Modeling Naive Psychology of Characters in Simple Commonsense Storiescited by 59
  14. 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
  15. 2024LongGenBench: Benchmarking Long-Form Generation in Long Context LLMscited by 47
  16. 2025LitBench: A Benchmark and Dataset for Reliable Evaluation of Creative Writingcited by 39
  17. 2024Do Language Models Enjoy Their Own Stories? Prompting Large Language Models for Automatic Story Evaluationcited by 32
  18. 2024Generating Long-form Story Using Dynamic Hierarchical Outlining with Memory-Enhancementcited by 30
  19. 2024CollabStory: Multi-LLM Collaborative Story Generation and Authorship Analysiscited by 26
  20. 2024Language Models can Self-Lengthen to Generate Long Textscited by 24
  21. 2025Finding Flawed Fictions: Evaluating Complex Reasoning in Language Models via Plot Hole Detectioncited by 24
  22. 2024Creating Suspenseful Stories: Iterative Planning with Large Language Modelscited by 22
  23. 2023Improving Pacing in Long-Form Story Planningcited by 21
  24. 2024Collective Critics for Creative Story Generationcited by 21
  25. 2025StoryWriter: A Multi-Agent Framework for Long Story Generationcited by 19
  26. 2025Beyond Outlining: Heterogeneous Recursive Planning for Adaptive Long-form Writing with Language Modelscited by 15
  27. 2025LongWriter-Zero: Mastering Ultra-Long Text Generation via Reinforcement Learningcited by 13
  28. 2024Ex3: Automatic Novel Writing by Extracting, Excelsior and Expandingcited by 10
  29. 2025Help Me Write a Story: Evaluating LLMs' Ability to Generate Writing Feedbackcited by 10
  30. 2024CHIRON: Rich Character Representations in Long-Form Narrativescited by 9
  31. 2025STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generationcited by 9
  32. 2024SWAG: Storytelling With Action Guidancecited by 8
  33. 2025Frankentext: Stitching random text fragments into long-form narrativescited by 8
  34. 2025Spotting Out-of-Character Behavior: Atomic-Level Evaluation of Persona Fidelity in Open-Ended Generationcited by 8
  35. 2024FACTTRACK: Time-Aware World State Tracking in Story Outlinescited by 6
  36. 2026Lost in Stories: Consistency Bugs in Long Story Generation by LLMscited by 6
  37. 2025SuperWriter: Reflection-Driven Long-Form Generation with Large Language Modelscited by 5
  38. 2025What Matters in Evaluating Book-Length Stories? A Systematic Study of Long Story Evaluationcited by 5

50 most cited of 63 All 63 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Personas to Plot: Character-Grounded Multi-Agent Story Generation for Long-Form Narratives
  2. 2026Shared Worlds, Private Minds: Structured Memory for Long-Form Writing as World Creation
  3. 2025CreAgentive: An Agent Workflow Driven Multi-Category Creative Generation Engine
  4. 2025NexusSum: Hierarchical LLM Agents for Long-Form Narrative Summarization
  5. 2025SCORE: Story Coherence and Retrieval Enhancement for AI Narratives
  6. 2026NARRA-Gym for Evaluating Interactive Narrative Agents
  7. 2026When Stories Evolve: Benchmarking LLM Storytelling Across Agent Architectures in Open-Ended World Simulations
  8. 2025Plug-and-Play Dramaturge: A Divide-and-Conquer Approach for Iterative Narrative Script Refinement via Collaborative LLM Agents