mlsanityData to 7 Oct 2026

PlotTwist: A Creative Plot Generation Framework with Small Language Models

arXiv 2603.16410 ↗First posted 17 Mar 2026cs.CL cs.AIcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

also in 1 more
Abstract (arXiv)

Creative plot generation presents a fundamental challenge for language models: transforming a concise premise into a coherent narrative that sustains global coherence, character development, pacing, tone consistency, and emotional progression. Although recent Large Language Models (LLMs) demonstrate strong fluency on general-purpose tasks, they require preference alignment to perform well on domain-specific tasks such as creative plot generation. However, conducting such alignment at the scale of frontier LLMs is computationally prohibitive, significantly limiting accessibility and practical deployment. To address this, we present PlotTwist, a structured framework that enables Small Language Models (SLMs) with ≤3B active parameters to generate high-quality, premise-conditioned plots competitive with frontier systems of vastly greater parameter scale. Our approach decomposes generation into three specialized components: (1) an Aspect Rating Reward Model, trained via a novel Positive-Negative prompting strategy; (2) a Mixture-of-Experts (MoE) plot generator aligned via Direct Preference Optimization (DPO); and (3) an Agentic Evaluation module using a cross-family jury for unbiased, independent post-hoc assessment. Extensive experiments demonstrate that PlotTwist consistently outperforms all baselines, including frontier models, across multiple Narrative Quality Dimensions (NQDs), achieving higher win rates against every baseline except the strongest, with which it remains competitive. Further validation confirms strong sensitivity to narrative quality, as the framework reliably distinguishes plots derived from critically acclaimed versus widely panned screenplays. Together, these results establish structured, preference-based alignment as a resource-efficient approach to high-quality creative plot generation. Project page: https://abhinavthorat.github.io/plottwist/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 27 of its 50 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

27 of 50 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025LitBench: A Benchmark and Dataset for Reliable Evaluation of Creative Writing1 Jul
  2. 2024LLM Evaluators Recognize and Favor Their Own Generations15 Apr

Other references · 25

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2025Qwen3 Technical Reportcited by 8,195
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  7. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  8. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  9. 2018Hierarchical Neural Story Generationcited by 1,182
  10. 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 865
  11. 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
  12. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
13 more
  1. 2024Justice or Prejudice? Quantifying Biases in LLM-as-a-Judgecited by 354
  2. 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Modelscited by 301
  3. 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 232
  4. 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 168
  5. 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 104
  6. 2019Do Massively Pretrained Language Models Make Better Storytellers?cited by 90
  7. 2023Evaluating the Zero-shot Robustness of Instruction-tuned Language Modelscited by 63
  8. 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
  9. 2025Learning to Reason for Long-Form Story Generationcited by 34
  10. 2025When AIs Judge AIs: The Rise of Agent-as-a-Judge Evaluation for LLMscited by 16
  11. 2025The Silent Judge: Unacknowledged Shortcut Bias in LLM-as-a-Judgecited by 13
  12. 2025CML-Bench: A Framework for Evaluating and Enhancing LLM-Powered Movie Scripts Generationcited by 6
  13. 2025Curiosity-Driven LLM-as-a-judge for Personalized Creative Judgmentcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025COS(M+O)S: Curiosity and RL-Enhanced MCTS for Exploring Story Space via Language Models
  2. 2026CreativeInstruct: Scalably Teaching LLMs to Balance Quality, Creativity, and Diversity
  3. 2026Planning Beyond Text: Graph-based Reasoning for Complex Narrative Generation
  4. 2026Rewarding Creativity: A Human-Aligned Generative Reward Model for Reinforcement Learning in Storytelling
  5. 2025StoryWriter: A Multi-Agent Framework for Long Story Generation
  6. 2022Little Red Riding Hood Goes Around the Globe:Crosslingual Story Planning and Generation with Large Language Models
  7. 2023GROVE: A Retrieval-augmented Complex Story Generation Framework with A Forest of Evidence
  8. 2026StoryAlign: Evaluating and Training Reward Models for Story Generation