ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies
Not on the map. Why?
Abstract (arXiv)
Text-driven image editing has achieved remarkable success in following single instructions. However, real-world scenarios often involve complex, multi-step instructions, particularly ``chain'' instructions where operations are interdependent. Current models struggle with these intricate directives, and existing benchmarks inadequately evaluate such capabilities. Specifically, they often overlook multi-instruction and chain-instruction complexities, and common consistency metrics are flawed. To address this, we introduce ComplexBench-Edit, a novel benchmark designed to systematically assess model performance on complex, multi-instruction, and chain-dependent image editing tasks. ComplexBench-Edit also features a new vision consistency evaluation method that accurately assesses non-modified regions by excluding edited areas. Furthermore, we propose a simple yet powerful Chain-of-Thought (CoT)-based approach that significantly enhances the ability of existing models to follow complex instructions. Our extensive experiments demonstrate ComplexBench-Edit's efficacy in differentiating model capabilities and highlight the superior performance of our CoT-based method in handling complex edits. The data and code are released at https://github.com/llllly26/ComplexBench-Edit.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Builds on 22 of its 38 references that are in the map. First posted on arXiv 15 Jun 2025.
Builds on
22 of 38 references.
References · 22
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
10 more
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2024Visual In-Context Learning for Large Vision-Language Modelscited by 128
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
- 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 63
- 2025VARGPT: Unified Understanding and Generation in a Visual Autoregressive Multimodal Large Language Modelcited by 44
- 2023Object-aware Inversion and Reassembly for Image Editingcited by 30
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
- 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 27
- 2024Diffusion Model with Representation Alignment for Protein Inverse Foldingcited by 10
Built on by
Citing papers per year: 2025: 9; 2026: 12.
21 papers.
Sort:
By area:
- 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 25
- 2025X-Ray-CoT: Interpretable Chest X-ray Diagnosis with Vision-Language Models via Chain-of-Thought Reasoningcited by 4
- 2026ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Servicescited by 4
- 2025Coherent Multimodal Reasoning with Iterative Self-Evaluation for Vision-Language Modelscited by 3
- 2026Generative Visual Chain-of-Thought for Image Editingcited by 3
- 2026CREval: An Automated Interpretable Evaluation for Creative Image Manipulation under Complex Instructionscited by 3
- 2025MV-CoRe: Multimodal Visual-Conceptual Reasoning for Complex Visual Question Answeringcited by 2
- 2025CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMscited by 1
- 2025LumiGen: An LVLM-Enhanced Iterative Framework for Fine-Grained Text-to-Image Generationcited by 1
- 2025Context-Aware Multi-Turn Visual-Textual Reasoning in LVLMs via Dynamic Memory and Adaptive Visual Guidancecited by 1
- 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Modelscited by 1
- 2026LADR: Locality-Aware Dynamic Rescue for Efficient Text-to-Image Generation with Diffusion Large Language Modelscited by 1
9 more
- 2025LVLM-Composer's Explicit Planning for Image Generationcited by 0
- 2025Contextualized Multimodal Lifelong Person Re-Identification in Hybrid Clothing Statescited by 0
- 2026LsrIF: Enhancing Logic-Structured Instruction Following of Large Language Modelscited by 0
- 2026AE-LLM: Adaptive Efficiency Optimization for Large Language Modelscited by 0
- 2026Hierarchical Retrieval Augmented Generation for Adversarial Technique Annotation in Cyber Threat Intelligence Textcited by 0
- 2026CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferencescited by 0
- 2026Spectral Origins of the Self-Correction Blind Spot in Autoregressive Generationcited by 0
- 2026Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applicationscited by 0
- 2026Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operationcited by 0
- 2026Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operation12 Oct 2026
- 2026Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications28 Jul 2026
- 2026Spectral Origins of the Self-Correction Blind Spot in Autoregressive Generation9 Jul 2026
- 2026CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferences30 May 2026
- 2026ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Services27 Apr 2026
- 2026CREval: An Automated Interpretable Evaluation for Creative Image Manipulation under Complex Instructions27 Mar 2026
- 2026Hierarchical Retrieval Augmented Generation for Adversarial Technique Annotation in Cyber Threat Intelligence Text24 Mar 2026
- 2026AE-LLM: Adaptive Efficiency Optimization for Large Language Models20 Mar 2026
- 2026LADR: Locality-Aware Dynamic Rescue for Efficient Text-to-Image Generation with Diffusion Large Language Models13 Mar 2026
- 2026Generative Visual Chain-of-Thought for Image Editing2 Mar 2026
- 2026LsrIF: Enhancing Logic-Structured Instruction Following of Large Language Models10 Jan 2026
- 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Models2 Jan 2026
9 more
- 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmark3 Nov 2025
- 2025Contextualized Multimodal Lifelong Person Re-Identification in Hybrid Clothing States14 Sep 2025
- 2025Context-Aware Multi-Turn Visual-Textual Reasoning in LVLMs via Dynamic Memory and Adaptive Visual Guidance6 Sep 2025
- 2025X-Ray-CoT: Interpretable Chest X-ray Diagnosis with Vision-Language Models via Chain-of-Thought Reasoning17 Aug 2025
- 2025MV-CoRe: Multimodal Visual-Conceptual Reasoning for Complex Visual Question Answering9 Aug 2025
- 2025LumiGen: An LVLM-Enhanced Iterative Framework for Fine-Grained Text-to-Image Generation5 Aug 2025
- 2025Coherent Multimodal Reasoning with Iterative Self-Evaluation for Vision-Language Models4 Aug 2025
- 2025CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMs22 Jul 2025
- 2025LVLM-Composer's Explicit Planning for Image Generation5 Jul 2025
- 2025X-Ray-CoT: Interpretable Chest X-ray Diagnosis with Vision-Language Models via Chain-of-Thought Reasoningcited by 4
- 2025Coherent Multimodal Reasoning with Iterative Self-Evaluation for Vision-Language Modelscited by 3
- 2026Generative Visual Chain-of-Thought for Image Editingcited by 3
- 2025MV-CoRe: Multimodal Visual-Conceptual Reasoning for Complex Visual Question Answeringcited by 2
- 2025CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMscited by 1
- 2025Context-Aware Multi-Turn Visual-Textual Reasoning in LVLMs via Dynamic Memory and Adaptive Visual Guidancecited by 1
- 2026Generative Visual Chain-of-Thought for Image Editing2 Mar 2026
- 2025Context-Aware Multi-Turn Visual-Textual Reasoning in LVLMs via Dynamic Memory and Adaptive Visual Guidance6 Sep 2025
- 2025X-Ray-CoT: Interpretable Chest X-ray Diagnosis with Vision-Language Models via Chain-of-Thought Reasoning17 Aug 2025
- 2025MV-CoRe: Multimodal Visual-Conceptual Reasoning for Complex Visual Question Answering9 Aug 2025
- 2025Coherent Multimodal Reasoning with Iterative Self-Evaluation for Vision-Language Models4 Aug 2025
- 2025CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMs22 Jul 2025
- 2025LVLM-Composer's Explicit Planning for Image Generationcited by 0
- 2025LVLM-Composer's Explicit Planning for Image Generation5 Jul 2025
- 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 25
- 2026ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Servicescited by 4
- 2026CREval: An Automated Interpretable Evaluation for Creative Image Manipulation under Complex Instructionscited by 3
- 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Modelscited by 1
- 2025Contextualized Multimodal Lifelong Person Re-Identification in Hybrid Clothing Statescited by 0
- 2026LsrIF: Enhancing Logic-Structured Instruction Following of Large Language Modelscited by 0
- 2026Spectral Origins of the Self-Correction Blind Spot in Autoregressive Generationcited by 0
- 2026Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applicationscited by 0
- 2026Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operationcited by 0
- 2026Pixels or Code? Benchmarking Instruction-Guided Visual Artifact Operation12 Oct 2026
- 2026Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications28 Jul 2026
- 2026Spectral Origins of the Self-Correction Blind Spot in Autoregressive Generation9 Jul 2026
- 2026ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Services27 Apr 2026
- 2026CREval: An Automated Interpretable Evaluation for Creative Image Manipulation under Complex Instructions27 Mar 2026
- 2026LsrIF: Enhancing Logic-Structured Instruction Following of Large Language Models10 Jan 2026
- 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Models2 Jan 2026
- 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmark3 Nov 2025
- 2025Contextualized Multimodal Lifelong Person Re-Identification in Hybrid Clothing States14 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025CompBench: Benchmarking Complex Instruction-guided Image Editing
- 2026MCIE: Multimodal LLM-Driven Complex Instruction Image Editing with Spatial Guidance
- 2025I2I-Bench: A Comprehensive Benchmark Suite for Image-to-Image Editing Models
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models
- 2026PaintBench: Deterministic Evaluation of Precise Visual Editing
- 2026GEditBench v2: A Human-Aligned Benchmark for General Image Editing
- 2026DLEBench: Evaluating Small-scale Object Editing Ability for Instruction-based Image Editing Model
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs