GODBench: A Benchmark for Multimodal Large Language Models in Video Comment Art
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
Video Comment Art enhances user engagement by providing creative content that conveys humor, satire, or emotional resonance, requiring a nuanced and comprehensive grasp of cultural and contextual subtleties. Although Multimodal Large Language Models (MLLMs) and Chain-of-Thought (CoT) have demonstrated strong reasoning abilities in STEM tasks (e.g. mathematics and coding), they still struggle to generate creative expressions such as resonant jokes and insightful satire. Moreover, existing benchmarks are constrained by their limited modalities and insufficient categories, hindering the exploration of comprehensive creativity in video-based Comment Art creation. To address these limitations, we introduce GODBench, a novel benchmark that integrates video and text modalities to systematically evaluate MLLMs' abilities to compose Comment Art. Furthermore, inspired by the propagation patterns of waves in physics, we propose Ripple of Thought (RoT), a multi-step reasoning framework designed to enhance the creativity of MLLMs. Extensive experiments reveal that existing MLLMs and CoT methods still face significant challenges in understanding and generating creative video comments. In contrast, RoT provides an effective approach to improve creative composing, highlighting its potential to drive meaningful advancements in MLLM-based creativity. GODBench is publicly available at https://github.com/stan-lei/GODBench-ACL2025.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 22 of its 54 references that are in the map. First posted on arXiv 16 May 2025.
Builds on
22 of 54 references.
References · 22
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 291
- 2024Marco-o1: Towards Open Reasoning Models for Open-Ended Solutionscited by 144
- 2024Human Creativity in the Age of LLMs: Randomized Experiments on Divergent and Convergent Thinkingcited by 43
- 2024Assessing and Understanding Creativity in Large Language Modelscited by 35
- 2023MacGyver: Are Large Language Models Creative Problem Solvers?cited by 34
10 more
- 2023Probing the Creativity of Large Language Models: Can models produce divergent semantic association?cited by 33
- 2023The Role of Chain-of-Thought in Complex Vision-Language Reasoning Taskcited by 32
- 2024Divergent Creativity in Humans and Large Language Modelscited by 31
- 2022ExPUNations: Augmenting Puns with Keywords and Explanationscited by 21
- 2024"A good pun is its own reword": Can Large Language Models Understand Puns?cited by 21
- 2024II-Bench: An Image Implication Understanding Benchmark for Multimodal Large Language Modelscited by 16
- 2024Creative Problem Solving in Large Language and Vision Models -- What Would it Take?cited by 7
- 2024HOTVCOM: Generating Buzzworthy Comments for Videoscited by 7
- 2024Chumor 2.0: Towards Benchmarking Chinese Humor Understandingcited by 4
- 2020Explaining Creative Artifactscited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026LiViBench: An Omnimodal Benchmark for Interactive Livestream Video Understandingcited by 8
- 2026HotComment: A Benchmark for Evaluating Popularity of Online Commentscited by 3
- 2026Towards High-Level Semantic Intelligencecited by 0
- 2026Reading Between the Frames of Multimodal Drivelologycited by 0
- 2026Too Good to Be Real? Diagnosing and Reducing the Gap Between AI Preference and Real User Engagementcited by 0
- 2026Too Good to Be Real? Diagnosing and Reducing the Gap Between AI Preference and Real User Engagement16 Sep 2026
- 2026Reading Between the Frames of Multimodal Drivelology5 Aug 2026
- 2026Towards High-Level Semantic Intelligence27 Jul 2026
- 2026HotComment: A Benchmark for Evaluating Popularity of Online Comments28 Apr 2026
- 2026LiViBench: An Omnimodal Benchmark for Interactive Livestream Video Understanding21 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Causality-aware Paradigm for Evaluating Creativity of Multimodal Large Language Models
- 2025Creation-MMBench: Assessing Context-Aware Creative Intelligence in MLLM
- 2026Computational Humor with Multimodal LLMs: Methods, Datasets, Evaluation, and Challenges
- 2026MuseBench: Benchmarking Intent-Level Audiovisual Arts Understanding in MLLMs
- 2025v-HUB: A Benchmark for Video Humor Understanding from Vision and Sound
- 2025HUMORCHAIN: Theory-Guided Multi-Stage Reasoning for Interpretable Multimodal Humor Generation
- 2025Laugh, Relate, Engage: Stylized Comment Generation for Short Videos
- 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigm