mlsanityData to 14 Oct 2026

Re3: Generating Longer Stories With Recursive Reprompting and Revision

arXiv 2210.06774 ↗First posted 13 Oct 2022cs.CL cs.AIcited by 193

Not on the map. Why?

Cited by 24 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We consider the problem of automatically generating longer stories of over two thousand words. Compared to prior work on shorter stories, long-range plot coherence and relevance are more central challenges here. We propose the Recursive Reprompting and Revision framework (Re3) to address these challenges by (a) prompting a general-purpose language model to construct a structured overarching plan, and (b) generating story passages by repeatedly injecting contextual information from both the plan and current story state into a language model prompt. We then revise by (c) reranking different continuations for plot coherence and premise relevance, and finally (d) editing the best continuation for factual consistency. Compared to similar-length stories generated directly from the same base model, human evaluators judged substantially more of Re3's stories as having a coherent overarching plot (by 14% absolute increase), and relevant to the given initial premise (by 20%).

Key facts. Cited by 193 papers in the map (data through 14 Oct 2026). Builds on 32 of its 54 references that are in the map. First posted on arXiv 13 Oct 2022.

Builds on

32 of 54 references.

References · 32

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  3. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  5. 2020Longformer: The Long-Document Transformercited by 3,413
  6. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  7. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  9. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  10. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  11. 2018Hierarchical Neural Story Generationcited by 1,193
  12. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 799
20 more
  1. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 476
  2. 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 378
  3. 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 376
  4. 2022Autoformalization with Large Language Modelscited by 263
  5. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
  6. 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collectionscited by 128
  7. 2019Strategies for Structuring Story Generationcited by 124
  8. 2020PlotMachines: Outline-Conditioned Generation with Dynamic Plot State Trackingcited by 105
  9. 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
  10. 2020Content Planning for Neural Story Generation with Aristotelian Rescoringcited by 92
  11. 2019Do Massively Pretrained Language Models Make Better Storytellers?cited by 90
  12. 2019Counterfactual Story Reasoning and Generationcited by 88
  13. 2020MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Modelscited by 74
  14. 2019Plan, Write, and Revise: an Interactive System for Open-Domain Story Generationcited by 43
  15. 2021Wordcraft: a Human-AI Collaborative Editor for Story Writingcited by 41
  16. 2016Language as a Latent Variable: Discrete Generative Models for Sentence Compressioncited by 28
  17. 2022Zero-shot Sonnet Generation with Discourse-level Planning and Aesthetics Featurescited by 25
  18. 2020Narrative Interpolation for Generating and Understanding Storiescited by 19
  19. 2022Language modeling via stochastic processescited by 18
  20. 2022Go Back in Time: Generating Flashbacks in Stories with Event Temporal Promptscited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 8; 2023: 53; 2024: 69; 2025: 36; 2026: 27.

193 papers.

Sort:

By area:

  1. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  2. 2023A Survey of Large Language Modelscited by 2,576
  3. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  4. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  5. 2023Augmented Language Models: a Surveycited by 403
  6. 2024TextGrad: Automatic "Differentiation" via Textcited by 273
  7. 2023Challenges and Applications of Large Language Modelscited by 254
  8. 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 240
  9. 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategiescited by 238
  10. 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
  11. 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 154
  12. 2024A Human-Inspired Reading Agent with Gist Memory of Very Long Contextscited by 146
38 more
  1. 2023Walking Down the Memory Maze: Beyond Context Limit through Interactive Readingcited by 133
  2. 2023Grounding Language Models to Images for Multimodal Inputs and Outputscited by 131
  3. 2023Rephrase and Respond: Let Large Language Models Ask Better Questions for Themselvescited by 123
  4. 2024Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffoldingcited by 117
  5. 2023DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedbackcited by 103
  6. 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
  7. 2023Shepherd: A Critic for Language Model Generationcited by 97
  8. 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 90
  9. 2024RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMscited by 90
  10. 2023RecurrentGPT: Interactive Generation of (Arbitrarily) Long Textcited by 84
  11. 2023Cognitive Mirage: A Review of Hallucinations in Large Language Modelscited by 84
  12. 2024Are Large Language Models Capable of Generating Human-Level Narratives?cited by 79
  13. 2023Unleashing the potential of prompt engineering for large language modelscited by 72
  14. 2022Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writingcited by 71
  15. 2023Prompted LLMs as Chatbot Modules for Long Open-domain Conversationcited by 61
  16. 2024Agents' Room: Narrative Generation through Multi-step Collaborationcited by 57
  17. 2023Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modelingcited by 56
  18. 2023Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generationcited by 55
  19. 2023Rehearsal: Simulating Conflict to Teach Conflict Resolutioncited by 55
  20. 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 51
  21. 2024Internal Consistency and Self-Feedback in Large Language Models: A Surveycited by 50
  22. 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 48
  23. 2024Confidence Matters: Revisiting Intrinsic Self-Correction Capabilities of Large Language Modelscited by 47
  24. 2023VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototypingcited by 46
  25. 2025WebWeaver: Structuring Web-Scale Evidence with Dynamic Outlines for Open-Ended Deep Researchcited by 46
  26. 2023CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Updatecited by 43
  27. 2024KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approachescited by 42
  28. 2024AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Textcited by 42
  29. 2023ChatLLM Network: More brains, More intelligencecited by 37
  30. 2024Leveraging Large Language Models for NLG Evaluation: Advances and Challengescited by 37
  31. 2024LLM Self-Correction with DeCRIM: Decompose, Critique, and Refine for Enhanced Following of Instructions with Multiple Constraintscited by 35
  32. 2023Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuningcited by 33
  33. 2025Reflect, Retry, Reward: Self-Improving LLMs via Reinforcement Learningcited by 33
  34. 2023Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writerscited by 32
  35. 2023Interactive Natural Language Processingcited by 31
  36. 2023Failures Pave the Way: Enhancing Large Language Models through Tuning-free Rule Accumulationcited by 30
  37. 2024AutoPSV: Automated Process-Supervised Verifiercited by 30
  38. 2024MR-Ben: A Meta-Reasoning Benchmark for Evaluating System-2 Thinking in LLMscited by 30

50 most cited of 193 All 193 (JSON)