VEBench:Benchmarking Large Multimodal Models for Real-World Video Editing
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Real-world video editing demands not only expert knowledge of cinematic techniques but also multimodal reasoning to select, align, and combine footage into coherent narratives. While recent Large Multimodal Models (LMMs) have shown remarkable progress in general video understanding, their abilities in multi-video reasoning and operational editing workflows remain largely unexplored. We introduce VEBENCH, the first comprehensive benchmark designed to evaluate both editing knowledge understanding and operational reasoning in realistic video editing scenarios. VEBENCH contains 3.9K high-quality edited videos (over 257 hours) and 3,080 human-verified QA pairs, built through a three-round human-AI collaborative annotation pipeline that ensures precise temporal labeling and semantic consistency. It features two complementary QA tasks: 1) Video Editing Technique Recognition, assessing models' ability to identify 7 editing techniques using multimodal cues; and 2) Video Editing Operation Simulation, modeling real-world editing workflows by requiring the selection and temporal localization of relevant clips from multiple candidates. Extensive experiments across proprietary (e.g., Gemini-2.5-Pro) and open-source LMMs reveal a large gap between current model performance and human-level editing cognition. These results highlight the urgent need for bridging video understanding with creative operational reasoning. We envision VEBENCH as a foundation for advancing intelligent video editing systems and driving future research on complex reasoning.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 28 of its 43 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
28 of 43 references.
Closest ancestors · 4
Same direction, newest first
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?27 May
- 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoning10 Apr
- 2024Motion-Grounded Video Reasoning: Understanding and Perceiving Motion at Pixel Level15 Nov
- 2022From Representation to Reasoning: Towards both Evidence and Commonsense Reasoning for Video Question-Answering30 May
Other references · 24
- 2023Visual Instruction Tuningcited by 7,792
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
- 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 616
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 571
- 2024Long Context Transfer from Language to Visioncited by 502
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 502
12 more
- 2018YouTube-VOS: A Large-Scale Video Object Segmentation Benchmarkcited by 381
- 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 225
- 2025VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactioncited by 191
- 2025OmniVideoBench: Towards Audio-Visual Understanding Evaluation for Omni MLLMscited by 54
- 2025Video-MMLU: A Massive Multi-Discipline Lecture Understanding Benchmarkcited by 37
- 2025ShotBench: Expert-Level Cinematic Understanding in Vision-Language Modelscited by 22
- 2019B-Script: Transcript-based B-roll Video Editing with Recommendationscited by 16
- 2025SciVideoBench: Benchmarking Scientific Video Reasoning in Large Multimodal Modelscited by 11
- 2024Beyond Raw Videos: Understanding Edited Videos with Large Multimodal Modelcited by 10
- 2025VEU-Bench: Towards Comprehensive Understanding of Video Editingcited by 7
- 2024Edit3K: Universal Representation Learning for Video Editing Componentscited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs
- 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessment
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editing
- 2026How Far Are Video Models from True Multimodal Reasoning?
- 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmark
- 2025IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessment
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects