Recipes for Creativity: Iterative Generation and Evaluation in Large Language Models
Not on the map. Why?
Abstract (arXiv)
Generative models are often evaluated through singular artifacts, whereas human creativity typically emerges through iterative generation, appraisal, and refinement. This pilot study examines whether iterative search improves LLM creativity by adapting FunSearch to recipe generation for the 2024 Pillsbury Bake-Off and evaluating outputs against human benchmarks using TTCT-based LLM evaluation. Across two experiments, we test iteration count, generator temperature, and in-loop selection-scorer model size. Results show that iterative generation-selection can produce recipes with creativity scores comparable to human benchmarks, but additional iterations alone do not improve creativity. The in-loop evaluator matters most: a smaller selection scorer yields significantly higher scores across most TTCT dimensions, while temperature has limited effects except for originality. These findings suggest that evaluator design is a first-order design variable in subjective creative search.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 26 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
8 of 26 references.
References · 8
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 172
- 2025Do LLM Evaluators Prefer Themselves for a Reason?cited by 38
- 2023Artificial muses: Generative Artificial Intelligence Chatbots Have Risen to Human-Level Creativitycited by 24
- 2024Collective Critics for Creative Story Generationcited by 22
- 2024Creative Beam Search: LLM-as-a-Judge For Improving Response Generationcited by 14
- 2024Do LLMs Agree on the Creativity Evaluation of Alternative Uses?cited by 6
- 2024Efficiency at Scale: Investigating the Performance of Diminutive Language Models in Clinical Taskscited by 4
Built on by
Not cited yet.