Living the Novel: A System for Generating Self-Training Timeline-Aware Conversational Agents from Novels
On the map: LLM agents and tool use → Multimodal and embodied agents
also in 1 more
Abstract (arXiv)
We present the Living Novel, an end-to-end system that transforms any literary work into an immersive, multi-character conversational experience. This system is designed to solve two fundamental challenges for LLM-driven characters. Firstly, generic LLMs suffer from persona drift, often failing to stay in character. Secondly, agents often exhibit abilities that extend beyond the constraints of the story's world and logic, leading to both narrative incoherence (spoiler leakage) and robustness failures (frame-breaking). To address these challenges, we introduce a novel two-stage training pipeline. Our Deep Persona Alignment (DPA) stage uses data-free reinforcement finetuning to instill deep character fidelity. Our Coherence and Robustness Enhancing (CRE) stage then employs a story-time-aware knowledge graph and a second retrieval-grounded training pass to architecturally enforce these narrative constraints. We validate our system through a multi-phase evaluation using Jules Verne's Twenty Thousand Leagues Under the Sea. A lab study with a detailed ablation of system components is followed by a 5-day in-the-wild diary study. Our DPA pipeline helps our specialized model outperform GPT-4o on persona-specific metrics, and our CRE stage achieves near-perfect performance in coherence and robustness measures. Our study surfaces practical design guidelines for AI-driven narrative systems: we find that character-first self-training is foundational for believability, while explicit story-time constraints are crucial for sustaining coherent, interruption-resilient mobile-web experiences.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 80 of its 109 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
80 of 109 references.
References · 80
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
38 more
- 2023Qwen Technical Reportcited by 3,273
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2024Qwen2 Technical Reportcited by 2,076
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2023Active Retrieval Augmented Generationcited by 506
- 2023RRHF: Rank Responses to Align Language Models with Human Feedback without tearscited by 454
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 310
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 244
- 2023How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Compositioncited by 222
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
- 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
- 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
- 2023LLM in a flash: Efficient Large Language Model Inference with Limited Memorycited by 170
- 2024EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real Worldcited by 93
- 2023MindAgent: Emergent Gaming Interactioncited by 87
- 2017Deep Voice: Real-time Neural Text-to-Speechcited by 83
- 2024Self-playing Adversarial Language Game Enhances LLM Reasoningcited by 80
- 2018Predicting Gaze in Egocentric Video by Learning Task-dependent Attention Transitioncited by 78
- 2025LLM Generated Persona is a Promise with a Catchcited by 77
- 2023Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agentscited by 76
- 2023Unleashing the potential of prompt engineering for large language modelscited by 72
- 2025Virgo: A Preliminary Exploration on Reproducing o1-like MLLMcited by 68
- 2019Mutual Context Network for Jointly Estimating Egocentric Gaze and Actionscited by 54
- 2019What Makes a Good Conversation? Challenges in Designing Truly Conversational Agentscited by 42
- 2024From LLM to Conversational Agent: A Memory Enhanced Architecture with Fine-Tuning of Large Language Modelscited by 42
- 2024A Multi-Agent Conversational Recommender Systemcited by 42
- 2024BioRAG: A RAG-LLM Framework for Biological Question Reasoningcited by 42
- 2025Language Self-Play For Data-Free Trainingcited by 42
- 2024Optimizing RLHF Training for Large Language Models with Stage Fusioncited by 41
- 2025The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Modelscited by 40
50 most cited of 80 All 80 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Staying In Character: Perspective-Bounded Memory For Book-Based Role-Playing Agents
- 2026Deep Persona: A Psychologically Grounded Architecture and Evaluation Framework for Role-Playing Agents and Simulations
- 2026SPASM: Stable Persona-driven Agent Simulation for Multi-turn Dialogue Generation
- 2026Can LLM Agents Stick to the Script? A Benchmark for Long-Horizon Consistency in Interactive Narratives
- 2025If an LLM Were a Character, Would It Know Its Own Story? Evaluating Lifelong Learning in LLMs
- 2026NARRA-Gym for Evaluating Interactive Narrative Agents
- 2026EvolvingWorld: An Open-Schema Framework for Co-Evolving Role-Play Agents and World Model in Interactive Literary World
- 2026From Personas to Plot: Character-Grounded Multi-Agent Story Generation for Long-Form Narratives