mlsanityData to 7 Oct 2026

Automating Creativity

arXiv 2405.06915 ↗First posted 11 May 2024cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative AI (GenAI) has spurred the expectation of being creative, due to its ability to generate content, yet so far, its creativity has somewhat disappointed, because it is trained using existing data following human intentions to generate outputs. The purpose of this paper is to explore what is required to evolve AI from generative to creative. Based on a reinforcement learning approach and building upon various research streams of computational creativity, we develop a triple prompt-response-reward engineering framework to develop the creative capability of GenAI. This framework consists of three components: 1) a prompt model for expected creativity by developing discriminative prompts that are objectively, individually, or socially novel, 2) a response model for observed creativity by generating surprising outputs that are incrementally, disruptively, or radically innovative, and 3) a reward model for improving creativity over time by incorporating feedback from the AI, the creator/manager, and/or the customers. This framework enables the application of GenAI for various levels of creativity strategically.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 62 references that are in the map. First posted on arXiv 11 May 2024.

Builds on

16 of 62 references.

References · 16

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  3. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  6. 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
  7. 2022PromptSource: An Integrated Development Environment and Repository for Natural Language Promptscited by 288
  8. 2023Pretraining Language Models with Human Preferencescited by 245
  9. 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
  10. 2023Art and the science of generative AI: A deeper divecited by 93
  11. 2023Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineeringcited by 40
  12. 2023Evolutionary Reinforcement Learning: A Surveycited by 24
4 more
  1. 2021Creativity and Machine Learning: A Surveycited by 21
  2. 2023Reinforcement Learning for Generative AI: A Surveycited by 11
  3. 2023Prompt Evolution for Generative AI: A Classifier-Guided Approachcited by 9
  4. 2022From Psychological Curiosity to Artificial Curiosity: Curiosity-Driven Learning in Artificial Intelligence Taskscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Investigating Creativity in Humans and Generative AI Through Circles Exercises ↗
  2. 2025E.A.R.T.H.: Structuring Creative Evolution through Model Error in Generative AI
  3. 2026Creativity in AI as Emergence from Domain-Limited Generative Models
  4. 2024Creative Agents: Simulating the Systems Model of Creativity with Generative Agents
  5. 2024Facilitating Human Feedback for GenAI Prompt Optimization
  6. 2025Training Emergent Joint Associations: A Reinforcement Learning Approach to Creative Thinking in Language Models
  7. 2025Stable diffusion models reveal a persisting human and AI gap in visual creativity
  8. 2025Thinking Outside the (Gray) Box: A Context-Based Score for Assessing Value and Originality in Neural Text Generation