Can MLLMs Decode the Creative Leap? Introducing C4 for Cross-Concept Understanding
Not on the map. Why?
Abstract (arXiv)
Creative capabilities of MLLMs matter in design, communication, education, and human--AI collaboration, yet remain difficult to evaluate because explicit targets and reward signals are scarce compared with accuracy-oriented tasks. Cross-concept understanding is a core cognitive capacity underlying receptive creativity. It enables a perceiver to recover intended meaning from non-obvious but meaningful conceptual relations. We operationalize item construction as cross-concept encoding and model inference as cross-concept decoding. We introduce C4, a cognition-inspired evaluation framework for Chengyu (Chinese idiom)-based Cross-Concept Creativity. Its encoding component maps target slots to imageable substitute concepts along bridge paths in a manually annotated and third-party-reviewed cross-concept network, enabling batch generation with explicit structure, difficulty indexed by bridge count and depth, and exact answers. Using this framework, we instantiate the C4 Evaluation Set (C4-Eval), comprising 184 synthetic items and 37 human-created cross-concept chengyu figures collected from online sources. We manually construct and review cross-concept relations, bridge paths, and reasoning processes for the collected figures. Each C4-Eval item is instantiated in five task settings, yielding 884 primary answer-recovery cases. Across ten evaluated MLLMs, the strongest closed models reach 50.7% and 48.0% primary accuracy, while open-source models remain substantially lower. Candidate constraints improve accuracy sharply, but bridge hints and explanation requests provide only modest gains. These results expose a substantial gap in how current MLLMs decode creatively encoded meaning through cross-concept relations. The code is in the supplementary material.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 27 of its 37 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
27 of 37 references.
References · 27
- 2025Qwen3-VL Technical Reportcited by 2,663
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,506
- 2015VQA: Visual Question Answeringcited by 2,495
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,057
- 2025Gemma 3 Technical Reportcited by 1,748
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,637
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,452
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,450
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,230
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,116
- 2025OpenAI GPT-5 System Cardcited by 946
- 2023A Survey on Multimodal Large Language Modelscited by 905
15 more
- 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 525
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 472
- 2018A Corpus for Reasoning About Natural Language Grounded in Photographscited by 457
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 450
- 2026MiMo-V2-Flash Technical Reportcited by 176
- 2023Art or Artifice? Large Language Models and the False Promise of Creativitycited by 168
- 2023Generative artificial intelligence enhances creativity but reduces the diversity of novel contentcited by 166
- 2024CMMMU: A Chinese Massive Multi-discipline Multimodal Understanding Benchmarkcited by 55
- 2023LatEval: An Interactive LLMs Evaluation Benchmark with Incomplete Information from Lateral Thinking Puzzlescited by 41
- 2024Divergent Creativity in Humans and Large Language Modelscited by 29
- 2024Humor in AI: Massive Scale Crowd-Sourced Preferences and Benchmarks for Cartoon Captioningcited by 19
- 2023BRAINTEASER: Lateral Thinking Puzzles for Large Language Modelscited by 18
- 2025Creation-MMBench: Assessing Context-Aware Creative Intelligence in MLLMcited by 14
- 2025A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Modelscited by 10
- 2024REBUS: A Robust Evaluation Benchmark of Understanding Symbolscited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CreativityPrism: A Cross-Domain Evaluation Framework for Large Language Model Creativity
- 2025Probing and Inducing Combinational Creativity in Vision-Language Models
- 2023Fluid Transformers and Creative Analogies: Exploring Large Language Models' Capacity for Augmenting Cross-Domain Analogical Creativity
- 2025CreBench: Human-Aligned Creativity Evaluation from Idea to Process to Product
- 2025S-DAT: A Multilingual, GenAI-Driven Framework for Automated Divergent Thinking Assessment
- 2026How LLMs See Creativity: Zero-Shot Scoring of Visual Creativity with Interpretable Reasoning
- 2023Automatic Assessment of Divergent Thinking in Chinese Language with TransDis: A Transformer-Based Language Model Approach
- 2025COIG-Writer: A High-Quality Dataset for Chinese Creative Writing with Thought Processes