mlsanityData to 14 Oct 2026

Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing

arXiv 2210.13669 ↗First posted 25 Oct 2022cs.CLcited by 71

Not on the map. Why?

Abstract (arXiv)

Recent work in training large language models (LLMs) to follow natural language instructions has opened up exciting opportunities for natural language interface design. Building on the prior success of LLMs in the realm of computer-assisted creativity, we aim to study if LLMs can improve the quality of user-generated content through collaboration. We present CoPoet, a collaborative poetry writing system. In contrast to auto-completing a user's text, CoPoet is controlled by user instructions that specify the attributes of the desired text, such as Write a sentence about `love' or Write a sentence ending in `fly'. The core component of our system is a language model fine-tuned on a diverse collection of instructions for poetry writing. Our model is not only competitive with publicly available LLMs trained on instructions (InstructGPT), but is also capable of satisfying unseen compositional instructions. A study with 15 qualified crowdworkers shows that users successfully write poems with CoPoet on diverse topics ranging from Monarchy to Climate change. Further, the collaboratively written poems are preferred by third-party evaluators over those written without the system.

Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). Builds on 29 of its 51 references that are in the map. First posted on arXiv 25 Oct 2022.

Builds on

29 of 51 references.

References · 29

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  7. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  8. 2022Emergent Abilities of Large Language Modelscited by 2,512
  9. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
  10. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  11. 2018Hierarchical Neural Story Generationcited by 1,193
  12. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 699
17 more
  1. 2022CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilitiescited by 249
  2. 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
  3. 2022Co-Writing Screenplays and Theatre Scripts with Language Models: An Evaluation by Industry Professionalscited by 191
  4. 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
  5. 2020Enabling Language Models to Fill in the Blankscited by 122
  6. 2021A Recipe For Arbitrary Text Style Transfer with Large Language Modelscited by 107
  7. 2019Do Massively Pretrained Language Models Make Better Storytellers?cited by 90
  8. 2020STORIUM: A Dataset and Evaluation Platform for Machine-in-the-Loop Story Generationcited by 56
  9. 2022Read, Revise, Repeat: A System Demonstration for Human-in-the-loop Iterative Text Revisioncited by 46
  10. 2021Wordcraft: a Human-AI Collaborative Editor for Story Writingcited by 41
  11. 2022Zero-shot Sonnet Generation with Discourse-level Planning and Aesthetics Featurescited by 25
  12. 2022PoeLM: A Meter- and Rhyme-Controllable Language Model for Unsupervised Poetry Generationcited by 22
  13. 2022Exploring the Role of Task Transferability in Large-Scale Multi-Task Learningcited by 17
  14. 2022HELP ME THINK: A Simple Prompting Strategy for Non-experts to Create Customized Content with Modelscited by 17
  15. 2021Don't Go Far Off: An Empirical Study on Neural Poetry Translationcited by 15
  16. 2021Machine-in-the-Loop Rewriting for Creative Image Captioningcited by 11
  17. 2021Augmenting Poetry Composition with Verse by Versecited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 3; 2023: 22; 2024: 22; 2025: 16; 2026: 8.

71 papers.

Sort:

By area:

  1. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  2. 2023Instruction Tuning for Large Language Models: A Surveycited by 623
  3. 2023Challenges and Applications of Large Language Modelscited by 254
  4. 2023Does Writing with Language Models Reduce Content Diversity?cited by 192
  5. 2023The Curious Decline of Linguistic Diversity: Training Language Models on Synthetic Textcited by 100
  6. 2022Evaluating Human-Language Model Interactioncited by 92
  7. 2023Pearl: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrieverscited by 92
  8. 2024A Design Space for Intelligent and Interactive Writing Assistantscited by 76
  9. 2024Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluationcited by 74
  10. 2023On the Creativity of Large Language Modelscited by 57
  11. 2023Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generationcited by 56
  12. 2025Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Abovecited by 52
38 more
  1. 2023Evaluating Instruction-Tuned Large Language Models on Code Comprehension and Generationcited by 50
  2. 2023VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototypingcited by 46
  3. 2024From Role-Play to Drama-Interaction: An LLM Solutioncited by 42
  4. 2024Benchmarking Linguistic Diversity of Large Language Modelscited by 38
  5. 2023Beyond the Chat: Executable and Verifiable Text-Editing with LLMscited by 35
  6. 2023MacGyver: Are Large Language Models Creative Problem Solvers?cited by 34
  7. 2023Large Language Model Instruction Following: A Survey of Progresses and Challengescited by 31
  8. 2023Interactive Natural Language Processingcited by 31
  9. 2023I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphorscited by 31
  10. 2024A Robot Walks into a Bar: Can Language Models Serve as Creativity Support Tools for Comedy? An Evaluation of LLMs' Humour Alignment with Comedianscited by 29
  11. 2024Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing?cited by 27
  12. 2024CollabStory: Multi-LLM Collaborative Story Generation and Authorship Analysiscited by 26
  13. 2022ByGPT5: End-to-End Style-conditioned Poetry Generation with Token-free Language Modelscited by 25
  14. 2023Generation Probabilities Are Not Enough: Uncertainty Highlighting in AI Code Completionscited by 20
  15. 2023Beyond Prompts: Exploring the Design Space of Mixed-Initiative Co-Creativity Systemscited by 20
  16. 2024Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writerscited by 19
  17. 2024Evaluating Diversity in Automatic Poetry Generationcited by 17
  18. 2024LLM-based multi-agent poetry generation in non-cooperative environmentscited by 15
  19. 2025HACo-Det: A Study Towards Fine-Grained Machine-Generated Text Detection under Human-AI Coauthoringcited by 15
  20. 2024How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs?cited by 13
  21. 2024Innovative Thinking, Infinite Humor: Humor Research of Large Language Models through Structured Thought Leapscited by 13
  22. 2024Does ChatGPT Have a Poetic Style?cited by 12
  23. 2025Help Me Write a Story: Evaluating LLMs' Ability to Generate Writing Feedbackcited by 11
  24. 2024From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating Mobile UI Operation Impactscited by 10
  25. 2025A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Modelscited by 10
  26. 2025Towards Enhanced Immersion and Agency for LLM-based Interactive Dramacited by 9
  27. 2025SPHERE: An Evaluation Card for Human-AI Systemscited by 9
  28. 2023Unified Text Structuralization with Instruction-tuned Language Modelscited by 8
  29. 2024SARD: A Human-AI Collaborative Story Generationcited by 8
  30. 2025Frankentext: Stitching random text fragments into long-form narrativescited by 8
  31. 2024Creativity in AI: Progresses and Challengescited by 7
  32. 2023LMCanvas: Object-Oriented Interaction to Personalize Large Language Model-Powered Writing Environmentscited by 6
  33. 2023DEFT: Data Efficient Fine-Tuning for Pre-Trained Language Models via Unsupervised Core-Set Selectioncited by 6
  34. 2025Measuring LLM Novelty As The Frontier Of Original And High-Quality Outputcited by 6
  35. 2025When Style Breaks Safety: Defending LLMs Against Superficial Style Alignmentcited by 6
  36. 2024Investigating Wit, Creativity, and Detectability of Large Language Models in Domain-Specific Writing Style Adaptation of Reddit's Showerthoughtscited by 5
  37. 2025Chandomitra: Towards Generating Structured Sanskrit Poetry from Natural Language Inputscited by 5
  38. 2025Collaborative Document Editing with Multiple Users and AI Agentscited by 5

50 most cited of 71 All 71 (JSON)