mlsanityData to 14 Oct 2026

Style over Story: Measuring LLM Narrative Preferences via Structured Selection

arXiv 2510.02025 ↗First posted 2 Oct 2025cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

We introduce a constraint-selection-based experiment design for measuring narrative preferences of Large Language Models (LLMs). This design offers an interpretable lens on LLMs' narrative selection behavior. We developed a library of 200 narratology-grounded constraints and prompted selections from six LLMs under three different instruction types: basic, quality-focused, and creativity-focused. Findings demonstrate that models consistently prioritize Style over narrative content elements like Event, Character, and Setting. Style preferences remain stable across models and instruction types, whereas content elements show cross-model divergence and instructional sensitivity. These results suggest that LLMs have latent narrative preferences, which should inform how the NLP community evaluates and deploys models in creative domains.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 37 references that are in the map. First posted on arXiv 2 Oct 2025.

Builds on

18 of 37 references.

References · 18

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  3. 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,135
  4. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 269
  5. 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
  6. 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
  7. 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 167
  8. 2024ProSA: Assessing and Understanding the Prompt Sensitivity of LLMscited by 149
  9. 2023A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writingcited by 99
  10. 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
  11. 2023You don't need a personality test to know these models are unreliable: Assessing the Reliability of Large Language Models on Psychometric Instrumentscited by 48
  12. 2024Echoes in AI: Quantifying lack of plot diversity in LLM outputscited by 48
6 more
  1. 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 36
  2. 2024Creating Suspenseful Stories: Iterative Planning with Large Language Modelscited by 22
  3. 2024LMLPA: Language Model Linguistic Personality Assessmentcited by 15
  4. 2025Measuring Political Preferences in AI Systems: An Integrative Approachcited by 9
  5. 2025Large Language Models Often Say One Thing and Do Anothercited by 8
  6. 2025A Comparative Study of Large Language Models and Human Personality Traitscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026QUIET: A Multi-Blank Cascaded Story Cloze Benchmark for LLM Creative Generation Capability
  2. 2024Are Large Language Models Capable of Generating Human-Level Narratives?
  3. 2026StoryAlign: Evaluating and Training Reward Models for Story Generation
  4. 2026The Storyteller in the Model: Narrative Pattern Inheritance, Escalation Dynamics, and Alignment Governance in LLMs
  5. 2026NARRA-Gym for Evaluating Interactive Narrative Agents
  6. 2026Narrative Flattening: How Post-Training Compresses Thematic, Affective, and Stylistic Variation in LLM Fiction
  7. 2026StoryLens: Preference-Aligned Story Rewriting via Context-Aware Narrative Enrichment
  8. 2025Can LLMs Generate Good Stories? Insights and Challenges from a Narrative Planning Perspective