mlsanityData to 7 Oct 2026

CPI-Bench: A Comprehensive, Practical and Intelligent Benchmark for Real-World Image Editing

arXiv 2608.14546 ↗First posted 14 Aug 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

With the rapid advancement of image editing models and their widespread application across various domains, there is an increasingly urgent need to deploy these model capabilities directly into real-world scenarios. However, existing benchmarks remain confined to simple single-image tasks, suffering from limited coverage dimensions and an inability to effectively differentiate performance among diverse models. Consequently, they fail to reliably evaluate model performance in complex multi-image editing, highly demanding reasoning instructions, and practical deployment settings. To address these limitations, we propose CPI-Bench, a Comprehensive, Practical and Intelligent benchmark for real-world image editing. CPI-Bench comprises three core subsets: CPI-General-Bench, which comprehensively covers diverse editing tasks and introduces multi-image editing evaluation; CPI-Practical-Bench, which focuses on high-frequency real-user application scenarios; and CPI-Intelligent-Bench, which is dedicated to evaluating capabilities in highly demanding reasoning-based editing. Evaluation results of mainstream image editing models based on CPI-Bench demonstrate that CPI-Bench enhances performance differentiation among models. It provides a comprehensive and reliable quantification of gaps in general editing capabilities, practical deployment efficacy, and advanced reasoning-based editing, offering invaluable guidance for the future optimization of image editing models. Crucially, our ranking analysis reveals that CPI-Bench achieves the highest alignment with the Arena Image Edit Leaderboard, indicating stronger consistency with public human preference rankings, serving as an effective proxy for public human evaluations.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 28 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

21 of 28 references.

References · 21

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  7. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  8. 2025Qwen-Image Technical Reportcited by 973
  9. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  10. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  11. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
  12. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
9 more
  1. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
  2. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
  3. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
  4. 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 61
  5. 2026FireRed-Image-Edit-1.0 Technical Reportcited by 31
  6. 2026Qwen-Image-2.0 Technical Reportcited by 28
  7. 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 23
  8. 2025WiseEdit: Benchmarking Cognition- and Creativity-Informed Image Editingcited by 10
  9. 2026JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.