Narrative Lookahead in LLMs: Event-Level Decodability, Predictive Advantage, and Steering
Not on the map. Why?
Abstract (arXiv)
Do language models carry information about narrative events before writing them, and how far ahead? We examine narrative lookahead through salient, state-changing events rather than tokens or response-level attributes. We extract 23,355 LLM-annotated events from 2,000 stories generated by four open-weight LLMs, labeling them along three nonexclusive dimensions of change: within agents, between agents, and in the story world, with human validation on a subset. Event segmentation and plot-independent labels enable comparisons across stories at horizons measured in events rather than in tokens. At event ends, we probe hidden states for upcoming event types and compare predictions with text-only predictors using matched prefixes. Across four models, future event types are decodable above prevalence baselines for at least four subsequent events, but probes significantly outperform both primary text-only predictors only for the next event. In exploratory steering with OLMo-3.1-32B, a probe-derived direction shifts the proportion of the target event type in both intended directions at higher strengths. Our event-level approach links the prediction of future narrative developments to interventions that reshape subsequent event composition.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 56 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
21 of 56 references.
References · 21
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2019Designing and Interpreting Probes with Control Taskscited by 640
- 2018Plan-And-Write: Towards Better Automatic Storytellingcited by 234
- 2025Reasoning Models Know When They're Right: Probing Hidden States for Self-Verificationcited by 159
- 2023Future Lens: Anticipating Subsequent Tokens from a Single Hidden Statecited by 121
- 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 105
- 2017Event Representations for Automated Story Generation with Deep Neural Netscited by 63
- 2024Do language models plan ahead for future tokens?cited by 49
- 2024Activation Scaling for Steering and Interpreting Language Modelscited by 35
- 2025Steering off Course: Reliability Challenges in Steering Language Modelscited by 34
- 2024Unlocking the Future: Exploring Look-Ahead Planning Mechanistic Interpretability in Large Language Modelscited by 22
9 more
- 2021Salience-Aware Event Chain Modeling for Narrative Understandingcited by 15
- 2021Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Storiescited by 12
- 2024How Reliable are Causal Probing Interventions?cited by 11
- 2025STORYTELLER: An Enhanced Plot-Planning Framework for Coherent and Cohesive Story Generationcited by 10
- 2020Modeling Event Salience in Narratives via Barthes' Cardinal Functionscited by 6
- 2026Latent Planning Emerges with Scalecited by 6
- 2025Internal Planning in Language Models: Characterizing Horizon and Branch Awarenesscited by 1
- 2026RAPTOR: Ridge-Adaptive Logistic Probescited by 1
- 2026Where's the Plan? Locating Latent Planning in Language Models with Lightweight Mechanistic Interventionscited by 1
Built on by
Not cited yet.