UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs
Not on the map. Why?
Abstract (arXiv)
The evaluation of visual editing models remains fragmented across methods and modalities. Existing benchmarks are often tailored to specific paradigms, making fair cross-paradigm comparisons difficult, while video editing lacks reliable evaluation benchmarks. Furthermore, common automatic metrics often misalign with human preference, yet directly deploying large multimodal models (MLLMs) as evaluators incurs prohibitive computational and financial costs. We present UniEditBench, a unified benchmark for image and video editing that supports reconstruction-based and instruction-driven methods under a shared protocol. UniEditBench includes a structured taxonomy of nine image operations (Add, Remove, Replace, Change, Stroke-based, Extract, Adjust, Count, Reorder) and eight video operations, with coverage of challenging compositional tasks such as counting and spatial reordering. To enable scalable evaluation, we distill a high-capacity MLLM judge (Qwen3-VL-235B-A22B Instruct) into lightweight 4B/8B evaluators that provide multi-dimensional scoring over structural fidelity, text alignment, background consistency, naturalness, and temporal-spatial consistency (for videos). Experiments show that the distilled evaluators maintain strong agreement with human judgments and substantially reduce deployment cost relative to the teacher model. UniEditBench provides a practical and reproducible protocol for benchmarking modern visual editing methods. Our benchmark and the associated reward models are publicly available at https://github.com/wesar1/UniEditBench.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 49 references that are in the map. First posted on arXiv 17 Apr 2026.
Builds on
29 of 49 references.
References · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
17 more
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2024Taming Rectified Flow for Inversion and Editingcited by 200
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 78
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 76
- 2023CVPR 2023 Text Guided Video Editing Competitioncited by 54
- 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
- 2025EditAR: Unified Conditional Generation with Autoregressive Modelscited by 40
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editingcited by 38
- 2025In-Context Learning with Unpaired Clips for Instruction-based Video Editingcited by 34
- 2025FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editingcited by 24
- 2025DNAEdit: Direct Noise Alignment for Text-Guided Rectified Flow Editingcited by 22
- 2025Visual Autoregressive Modeling for Instruction-Guided Image Editingcited by 21
- 2026Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editingcited by 18
- 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editingcited by 12
- 2025FIA-Edit: Frequency-Interactive Attention for Efficient and High-Fidelity Inversion-Free Text-Guided Image Editingcited by 8
- 2026SNR-Edit: Structure-Aware Noise Rectification for Inversion-Free Flow-Based Editingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PaintBench: Deterministic Evaluation of Precise Visual Editing
- 2026OmniEdit-Bench: A Comprehensive Benchmark for Instruction-based Video Editing
- 2026GEditBench v2: A Human-Aligned Benchmark for General Image Editing
- 2025InstructX: Towards Unified Visual Editing with MLLM Guidance
- 2026Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
- 2025ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies
- 2026VEBench:Benchmarking Large Multimodal Models for Real-World Video Editing
- 2026Uni-Edit: Intelligent Editing Is A General Task For Unified Model Tuning