CoVEBench: Can Video Editing Models Handle Complex Instructions?
Not on the map. Why?
Abstract (arXiv)
While recent text-guided video editing models excel at elementary tasks (e.g., style transfer, object insertion), real-world user requests are highly compositional. A single prompt often demands multiple coupled edits, such as modifying subjects, actions, and camera views, while strictly preserving unrelated spatiotemporal content. Existing benchmarks, heavily constrained by isolated edits and coarse global metrics, fail to diagnose how models handle such complex workflows. To address this gap, we introduce CoVEBench, a compositional video editing benchmark comprising 416 curated source videos, 626 multi-point editing instructions, and 9,990 fine-grained checklist items. Covering diverse editing dimensions, CoVEBench evaluates models via MLLM-judged instruction compliance and video fidelity, alongside automated metrics for video quality. Extensive experiments reveal that compositional editing remains a profound challenge: current models frequently omit edits, violate preservation constraints, or introduce artifacts when handling multiple operations simultaneously. CoVEBench provides a challenging, diagnostic testbed to advance video editing toward realistic user workflows.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 30 of its 73 references that are in the map. First posted on arXiv 7 Jun 2026.
Builds on
30 of 73 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Visual Instruction Tuningcited by 7,792
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
18 more
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2023FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editingcited by 165
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
- 2023Consistent Video-to-Video Transfer Using Synthetic Datasetcited by 79
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 47
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 34
- 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 34
- 2025IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessmentcited by 27
- 2026OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoningcited by 25
- 2025Region-Constraint In-Context Generation for Instructional Video Editingcited by 22
- 2025T2AV-Compass: Towards Unified Evaluation for Text-to-Audio-Video Generationcited by 19
- 2026UniVBench: Towards Unified Evaluation for Video Foundation Modelscited by 13
- 2024EditBoard: Towards a Comprehensive Evaluation Benchmark for Text-Based Video Editing Modelscited by 10
- 2025TDVE-Assessor: Benchmarking and Evaluating the Quality of Text-Driven Video Editing with LMMscited by 10
Built on by
Citing papers per year: 2026: 2.
2 papers.