InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Models
Not on the map. Why?
Abstract (arXiv)
Multimodal generative models have made significant strides in image editing, demonstrating impressive performance on a variety of static tasks. However, their proficiency typically does not extend to complex scenarios requiring dynamic reasoning, leaving them ill-equipped to model the coherent, intermediate logical pathways that constitute a multi-step evolution from an initial state to a final one. This capacity is crucial for unlocking a deeper level of procedural and causal understanding in visual manipulation. To systematically measure this critical limitation, we introduce InEdit-Bench, the first evaluation benchmark dedicated to reasoning over intermediate pathways in image editing. InEdit-Bench comprises meticulously annotated test cases covering four fundamental task categories: state transition, dynamic process, temporal sequence, and scientific simulation. Additionally, to enable fine-grained evaluation, we propose a set of assessment criteria to evaluate the logical coherence and visual naturalness of the generated pathways, as well as the model's fidelity to specified path constraints. Our comprehensive evaluation of 14 representative image editing models on InEdit-Bench reveals significant and widespread shortcomings in this domain. By providing a standardized and challenging benchmark, we aim for InEdit-Bench to catalyze research and steer development towards more dynamic, reason-aware, and intelligent multimodal generative models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 52 of its 64 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
52 of 64 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
38 more
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024OmniGen: Unified Image Generationcited by 394
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
- 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 173
- 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 119
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 71
- 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
- 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 63
- 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methodscited by 54
- 2024A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Modelscited by 52
- 2025Personalized Generation In Large Model Era: A Surveycited by 45
- 2024FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instructioncited by 36
- 2024Learning Action and Reasoning-Centric Image Editing from Videos and Simulationscited by 32
- 2025The Curse of CoT: On the Limitations of Chain-of-Thought in In-Context Learningcited by 30
- 2023What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Instruction Tuningcited by 28
- 2025Generative Multimodal Pretraining with Discrete Diffusion Timestep Tokenscited by 28
- 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 27
- 2023InstructAny2Pix: Flexible Visual Editing via Multimodal Instruction Followingcited by 25
- 2025ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editingcited by 24
- 2025WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generationcited by 20
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.