mlsanityData to 14 Oct 2026

CREward: A Type-Specific Creativity Reward Model

arXiv 2511.19995 ↗First posted 25 Nov 2025cs.CVcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Creativity is a complex phenomenon. When it comes to representing and assessing creativity, treating it as a single undifferentiated quantity would appear naive and underwhelming. In this work, we learn the first type-specific creativity reward model, coined CREward, which spans three creativity ``axes," geometry, material, and texture, to allow us to view creativity through the lens of the image formation pipeline. To build our reward model, we first conduct a human benchmark evaluation to capture human perception of creativity for each type across various creative images. We then analyze the correlation between human judgments and predictions by large vision-language models (LVLMs), confirming that LVLMs exhibit strong alignment with human perception. Building on this observation, we collect LVLM-generated labels to train our CREward model that is applicable to both evaluation and generation of creative images. We explore three applications of CREward: creativity assessment, explainable creativity, and creative sample acquisition for both human design inspiration and guiding creative generation through low-rank adaptation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 25 of its 36 references that are in the map. First posted on arXiv 25 Nov 2025.

Builds on

25 of 36 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Unified Reward Model for Multimodal Understanding and Generation7 Mar
  2. 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation30 Dec

Other references · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  9. 2025Gemma 3 Technical Reportcited by 1,824
  10. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  11. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  12. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
11 more
  1. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  2. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
  3. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  4. 2022Rarity Score : A New Metric to Evaluate the Uncommonness of Synthesized Imagescited by 35
  5. 2025SliderSpace: Decomposing the Visual Capabilities of Diffusion Modelscited by 26
  6. 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraintscited by 25
  7. 2024Kandinsky 3: Text-to-Image Synthesis for Multifunctional Generative Frameworkcited by 25
  8. 2025CREA: A Collaborative Multi-Agent Framework for Creative Image Editing and Generationcited by 14
  9. 2025Enhancing Creative Generation on Stable Diffusion-based Modelscited by 13
  10. 2023VLM-Eval: A General Evaluation on Video Large Language Modelscited by 7
  11. 2025Creative Blends of Visual Conceptscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026How LLMs See Creativity: Zero-Shot Scoring of Visual Creativity with Interpretable Reasoning
  2. 2025Probing and Inducing Combinational Creativity in Vision-Language Models
  3. 2025Leveraging Large Models to Evaluate Novel Content: A Case Study on Advertisement Creativity
  4. 2026Fine-Tuning a Large Vision-Language Model for Artwork's Scoring and Critique
  5. 2025CreBench: Human-Aligned Creativity Evaluation from Idea to Process to Product
  6. 2025Stable diffusion models reveal a persisting human and AI gap in visual creativity
  7. 2025Creation-MMBench: Assessing Context-Aware Creative Intelligence in MLLM
  8. 2025CreativityPrism: A Cross-Domain Evaluation Framework for Large Language Model Creativity