Understanding Virality: A Rubric based Vision-Language Model Framework for Short-Form Edutainment Evaluation
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Evaluating short-form video content requires moving beyond surface-level quality metrics toward human-aligned, multimodal reasoning. While existing frameworks like VideoScore-2 assess visual and semantic fidelity, they do not capture how specific audiovisual attributes drive real audience engagement. In this work, we propose a data-driven evaluation framework that uses Vision-Language Models (VLMs) to extract unsupervised audiovisual features, clusters them into interpretable factors, and trains a regression-based evaluator to predict engagement on short-form edutainment videos. Our curated YouTube Shorts dataset enables systematic analysis of how VLM-derived features relate to human engagement behavior. Experiments show strong correlations between predicted and actual engagement, demonstrating that our lightweight, feature-based evaluator provides interpretable and scalable assessments compared to traditional metrics (e.g., SSIM, FID). By grounding evaluation in both multimodal feature importance and human-centered engagement signals, our approach advances toward robust and explainable video understanding.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 7 of its 14 references that are in the map. First posted on arXiv 24 Dec 2025.
Builds on
7 of 14 references.
References · 7
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2017Deep reinforcement learning from human preferencescited by 3,846
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
- 2025VideoScore2: Think before You Score in Generative Video Evaluationcited by 37
- 2025Rendering-Aware Reinforcement Learning for Vector Graphics Generationcited by 36
- 2025GeoChain: Multimodal Chain-of-Thought for Geographic Reasoningcited by 16
- 2025MaRVL-QA: A Benchmark for Mathematical Reasoning over Visual Landscapescited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding
- 2025Towards Video Thinking Test: A Holistic Benchmark for Advanced Video Reasoning and Understanding
- 2026UniVBench: Towards Unified Evaluation for Video Foundation Models
- 2026Toward Scalable Audio Description Quality Control: A Workflow for Evaluating Human and VLM Raters
- 2025Engagement Prediction of Short Videos with Large Multimodal Models
- 2025HumanVideo-MME: Benchmarking MLLMs for Human-Centric Video Understanding
- 2026CinematicVQA: Benchmarking Film-Grammar Reasoning in Large Vision-Language Models
- 2026Can Vision-Language Models Analyze Human-Centered Video? Mapping Model Capabilities and Human-AI Collaborative Workflows