mlsanityData to 14 Oct 2026

What Shapes a Creative Machine Mind? Comprehensively Benchmarking Creativity in Foundation Models

arXiv 2510.04009 ↗First posted 5 Oct 2025cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

The meteoric rise of foundation models (FMs) has expanded their capabilities far beyond conventional tasks. Creativity, long regarded as a hallmark of human intelligence and a driver of innovation, is now increasingly recognized as a critical dimension of machine intelligence in the era of generative FMs, complementing traditional measures of accuracy. However, existing evaluation frameworks for creativity remain fragmented, relying on ad hoc metrics not firmly grounded in established theories. To address this gap, we introduce C^2-Eval, a holistic benchmark for unified assessment of creativity in FMs. C^2-Eval distinguishes between two complementary forms of creativity: convergent creativity, where tasks admit constrained solutions (e.g., code generation), and divergent creativity, where tasks are open-ended (e.g., storytelling). It evaluates both dimensions using fine-grained criteria derived from social-science theory, focusing on Usefulness, Originality, and Surprise (U-O-S). Through extensive experiments on leading proprietary and open-source models, we analyze trade-offs in their creative capabilities. Our results highlight both the strengths and challenges of current FMs in pursuing a creative machine mind, showing that C^2-Eval is an effective lens for examining the evolving landscape of creative AI.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 5 Oct 2025.

Builds on

24 of 46 references.

References · 24

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  6. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  7. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  8. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  9. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  10. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  11. 2025Gemma 3 Technical Reportcited by 1,824
  12. 2018Hierarchical Neural Story Generationcited by 1,193
12 more
  1. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  2. 2023Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMscited by 974
  3. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  4. 2024JudgeBench: A Benchmark for Evaluating LLM-based Judgescited by 318
  5. 2025NoveltyBench: Evaluating Language Models for Humanlike Diversitycited by 66
  6. 2022Putting GPT-3's Creativity to the (Alternative Uses) Testcited by 62
  7. 2024Benchmarking Language Model Creativity: A Case Study on Code Generationcited by 40
  8. 2024Assessing and Understanding Creativity in Large Language Modelscited by 35
  9. 2023MacGyver: Are Large Language Models Creative Problem Solvers?cited by 34
  10. 2024CreativEval: Evaluating Creativity of LLM-Based Hardware Code Generationcited by 19
  11. 2025Creation-MMBench: Assessing Context-Aware Creative Intelligence in MLLMcited by 14
  12. 2025Shakespearean Sparks: The Dance of Hallucination and Creativity in LLMs' Decoding Layerscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.