CREward: A Type-Specific Creativity Reward Model
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Creativity is a complex phenomenon. When it comes to representing and assessing creativity, treating it as a single undifferentiated quantity would appear naive and underwhelming. In this work, we learn the first type-specific creativity reward model, coined CREward, which spans three creativity ``axes," geometry, material, and texture, to allow us to view creativity through the lens of the image formation pipeline. To build our reward model, we first conduct a human benchmark evaluation to capture human perception of creativity for each type across various creative images. We then analyze the correlation between human judgments and predictions by large vision-language models (LVLMs), confirming that LVLMs exhibit strong alignment with human perception. Building on this observation, we collect LVLM-generated labels to train our CREward model that is applicable to both evaluation and generation of creative images. We explore three applications of CREward: creativity assessment, explainable creativity, and creative sample acquisition for both human design inspiration and guiding creative generation through low-rank adaptation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 25 of its 36 references that are in the map. First posted on arXiv 25 Nov 2025.
Builds on
25 of 36 references.
Closest ancestors · 2
Same direction, newest first
- 2025Unified Reward Model for Multimodal Understanding and Generation7 Mar
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation30 Dec
Other references · 23
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2025Gemma 3 Technical Reportcited by 1,824
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
11 more
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2022Rarity Score : A New Metric to Evaluate the Uncommonness of Synthesized Imagescited by 35
- 2025SliderSpace: Decomposing the Visual Capabilities of Diffusion Modelscited by 26
- 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraintscited by 25
- 2024Kandinsky 3: Text-to-Image Synthesis for Multifunctional Generative Frameworkcited by 25
- 2025CREA: A Collaborative Multi-Agent Framework for Creative Image Editing and Generationcited by 14
- 2025Enhancing Creative Generation on Stable Diffusion-based Modelscited by 13
- 2023VLM-Eval: A General Evaluation on Video Large Language Modelscited by 7
- 2025Creative Blends of Visual Conceptscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026How LLMs See Creativity: Zero-Shot Scoring of Visual Creativity with Interpretable Reasoning
- 2025Probing and Inducing Combinational Creativity in Vision-Language Models
- 2025Leveraging Large Models to Evaluate Novel Content: A Case Study on Advertisement Creativity
- 2026Fine-Tuning a Large Vision-Language Model for Artwork's Scoring and Critique
- 2025CreBench: Human-Aligned Creativity Evaluation from Idea to Process to Product
- 2025Stable diffusion models reveal a persisting human and AI gap in visual creativity
- 2025Creation-MMBench: Assessing Context-Aware Creative Intelligence in MLLM
- 2025CreativityPrism: A Cross-Domain Evaluation Framework for Large Language Model Creativity