mlsanityData to 7 Oct 2026

Bits of Grass: Does GPT already know how to write like Whitman?

arXiv 2305.11064 ↗First posted 10 May 2023cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

This study examines the ability of GPT-3.5, GPT-3.5-turbo (ChatGPT) and GPT-4 models to generate poems in the style of specific authors using zero-shot and many-shot prompts (which use the maximum context length of 8192 tokens). We assess the performance of models that are not fine-tuned for generating poetry in the style of specific authors, via automated evaluation. Our findings indicate that without fine-tuning, even when provided with the maximum number of 17 poem examples (8192 tokens) in the prompt, these models do not generate poetry in the desired style.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 3 of its 12 references that are in the map. First posted on arXiv 10 May 2023.

Builds on

3 of 12 references.

References · 3

  1. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  2. 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
  3. 2023Evaluating Verifiability in Generative Search Enginescited by 297

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 7; 2025: 2; 2026: 2.

13 papers.

Sort:

By area:

  1. 2023A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writingcited by 98
  2. 2024AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Textcited by 40
  3. 2024LLM-based multi-agent poetry generation in non-cooperative environmentscited by 15
  4. 2024Creative Beam Search: LLM-as-a-Judge For Improving Response Generationcited by 13
  5. 2024Subtle Biases Need Subtler Measures: Dual Metrics for Evaluating Representative and Affinity Bias in Large Language Modelscited by 10
  6. 2024PhonologyBench: Evaluating Phonological Skills of Large Language Modelscited by 7
  7. 2026Latent Planning Emerges with Scalecited by 5
  8. 2023Guided scenarios with simulated expert personae: a remarkable strategy to perform cognitive workcited by 3
  9. 2024Vietnamese Poem Generation & The Prospect Of Cross-Language Poem-To-Poem Translationcited by 2
  10. 2026POEMetric: The Last Stanza of Humanitycited by 2
  11. 2025Thinking Outside the (Gray) Box: A Context-Based Score for Assessing Value and Originality in Neural Text Generationcited by 1
  12. 2025Can Large Language Models Outperform Non-Experts in Poetry Evaluation? A Comparative Study Using the Consensual Assessment Techniquecited by 1
1 more
  1. 2024BIPro: Zero-shot Chinese Poem Generation via Block Inverse Prompting Constrained Generation Frameworkcited by 0