mlsanityData to 14 Oct 2026

ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies

arXiv 2506.12830 ↗First posted 15 Jun 2025cs.CVcited by 21

Not on the map. Why?

Abstract (arXiv)

Text-driven image editing has achieved remarkable success in following single instructions. However, real-world scenarios often involve complex, multi-step instructions, particularly ``chain'' instructions where operations are interdependent. Current models struggle with these intricate directives, and existing benchmarks inadequately evaluate such capabilities. Specifically, they often overlook multi-instruction and chain-instruction complexities, and common consistency metrics are flawed. To address this, we introduce ComplexBench-Edit, a novel benchmark designed to systematically assess model performance on complex, multi-instruction, and chain-dependent image editing tasks. ComplexBench-Edit also features a new vision consistency evaluation method that accurately assesses non-modified regions by excluding edited areas. Furthermore, we propose a simple yet powerful Chain-of-Thought (CoT)-based approach that significantly enhances the ability of existing models to follow complex instructions. Our extensive experiments demonstrate ComplexBench-Edit's efficacy in differentiating model capabilities and highlight the superior performance of our CoT-based method in handling complex edits. The data and code are released at https://github.com/llllly26/ComplexBench-Edit.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 22 of its 38 references that are in the map. First posted on arXiv 15 Jun 2025.

Builds on

22 of 38 references.

References · 22

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  7. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  8. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  9. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  10. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  11. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  12. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
10 more
  1. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  2. 2024Visual In-Context Learning for Large Vision-Language Modelscited by 128
  3. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  4. 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
  5. 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 63
  6. 2025VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language Modelcited by 44
  7. 2023Object-aware Inversion and Reassembly for Image Editingcited by 30
  8. 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
  9. 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 27
  10. 2024Diffusion Model with Representation Alignment for Protein Inverse Foldingcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 12.

21 papers.

Sort:

By area:

  1. 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 25
  2. 2025X-Ray-CoT: Interpretable Chest X-ray Diagnosis with Vision-Language Models via Chain-of-Thought Reasoningcited by 4
  3. 2026ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Servicescited by 4
  4. 2025Coherent Multimodal Reasoning with Iterative Self-Evaluation for Vision-Language Modelscited by 3
  5. 2026Generative Visual Chain-of-Thought for Image Editingcited by 3
  6. 2026CREval: An Automated Interpretable Evaluation for Creative Image Manipulation under Complex Instructionscited by 3
  7. 2025MV-CoRe: Multimodal Visual-Conceptual Reasoning for Complex Visual Question Answeringcited by 2
  8. 2025CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMscited by 1
  9. 2025LumiGen: An LVLM-Enhanced Iterative Framework for Fine-Grained Text-to-Image Generationcited by 1
  10. 2025Context-Aware Multi-Turn Visual-Textual Reasoning in LVLMs via Dynamic Memory and Adaptive Visual Guidancecited by 1
  11. 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Modelscited by 1
  12. 2026LADR: Locality-Aware Dynamic Rescue for Efficient Text-to-Image Generation with Diffusion Large Language Modelscited by 1
9 more
  1. 2025LVLM-Composer's Explicit Planning for Image Generationcited by 0
  2. 2025Contextualized Multimodal Lifelong Person Re-Identification in Hybrid Clothing Statescited by 0
  3. 2026LsrIF: Enhancing Logic-Structured Instruction Following of Large Language Modelscited by 0
  4. 2026AE-LLM: Adaptive Efficiency Optimization for Large Language Modelscited by 0
  5. 2026Hierarchical Retrieval Augmented Generation for Adversarial Technique Annotation in Cyber Threat Intelligence Textcited by 0
  6. 2026CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferencescited by 0
  7. 2026Spectral Origins of the Self-Correction Blind Spot in Autoregressive Generationcited by 0
  8. 2026Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applicationscited by 0
  9. 2026Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025CompBench: Benchmarking Complex Instruction-guided Image Editing
  2. 2026MCIE: Multimodal LLM-Driven Complex Instruction Image Editing with Spatial Guidance
  3. 2025I2I-Bench: A Comprehensive Benchmark Suite for Image-to-Image Editing Models
  4. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models
  5. 2026PaintBench: Deterministic Evaluation of Precise Visual Editing
  6. 2026GEditBench v2: A Human-Aligned Benchmark for General Image Editing
  7. 2026DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model
  8. 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs