StoryLens: Preference-Aligned Story Rewriting via Context-Aware Narrative Enrichment
On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment
Abstract (arXiv)
Story rewriting aims to adapt existing narratives to diverse reader preferences while preserving plot consistency and narrative coherence. Unlike conventional work on style transfer, we argue that effective story rewriting demands context-aware narrative enrichment beyond surface-level stylistic adaptation. Our pilot human study shows that style adaptation alone provides only marginal gains in reader satisfaction (2.3%), while context-enhanced rewriting substantially improves user preference alignment (24.5%). Motivated by this, we introduce STORYLENSBENCH, a large-scale benchmark for preference-aligned story rewriting, comprising structured story books, multi-dimensional reader preference profiles, and ranked context-aware rewritten stories. Building on this benchmark, we propose STORYLENSEVAL, a reward model for estimating reader satisfaction over rewritten stories, and STORYLENSWRITER, a two-stage rewriting model combining supervised fine-tuning with GRPO-based reinforcement learning. We further establish a comprehensive evaluation framework covering fidelity, coherence, and reader satisfaction. Experimental results demonstrate that STORYLENSWRITER consistently outperforms strong generation and personalization baselines, highlighting the importance of context-aware narrative enrichment for personalized story rewriting.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 24 of its 42 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
24 of 42 references.
Closest ancestors · 3
Same direction, newest first
- 2024Aligning to Thousands of Preferences via System Message Generalization28 May
- 2024Personalized Language Modeling from Personalized Human Feedback6 Feb
- 2023Learning Personalized Alignment for Evaluating Open-ended Text Generation5 Oct
Other references · 21
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2018Hierarchical Neural Story Generationcited by 1,182
- 2023LaMP: When Large Language Models Meet Personalizationcited by 425
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 376
- 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 232
- 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
- 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
- 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
- 2024User-LLM: Efficient LLM Contextualization with User Embeddingscited by 74
- 2024FABLES: Evaluating faithfulness and content selection in book-length summarizationcited by 65
- 2024Generating Long-form Story Using Dynamic Hierarchical Outlining with Memory-Enhancementcited by 30
9 more
- 2025ExPerT: Effective and Explainable Evaluation of Personalized Long-Form Text Generationcited by 26
- 2024Style-Specific Neurons for Steering LLMs in Text Style Transfercited by 24
- 2024Collective Critics for Creative Story Generationcited by 21
- 2025StoryWriter: A Multi-Agent Framework for Long Story Generationcited by 19
- 2021Does It Capture STEL? A Modular, Similarity-based Linguistic Style Evaluation Frameworkcited by 17
- 2022Semi-Supervised Formality Style Transfer with Consistency Trainingcited by 12
- 2024A Character-Centric Creative Story Generation via Imaginationcited by 12
- 2025STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generationcited by 9
- 2025What Matters in Evaluating Book-Length Stories? A Systematic Study of Long Story Evaluationcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026StoryAlign: Evaluating and Training Reward Models for Story Generation
- 2026Retell, Reward, Repeat: Reinforcement Learning for Narrative Theory-Informed Story Retelling
- 2026Directing the Narrative: A Finetuning Method for Controlling Coherence and Style in Story Generation
- 2025Style over Story: Measuring LLM Narrative Preferences via Structured Selection
- 2025COS(M+O)S: Curiosity and RL-Enhanced MCTS for Exploring Story Space via Language Models
- 2026Rewarding Creativity: A Human-Aligned Generative Reward Model for Reinforcement Learning in Storytelling
- 2022Robust Preference Learning for Storytelling via Contrastive Reinforcement Learning
- 2025Capturing Classic Authorial Style in Long-Form Story Generation with GRPO Fine-Tuning