mlsanityData to 14 Oct 2026

KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Models

arXiv 2505.16707 ↗First posted 22 May 2025cs.CVcited by 71

Not on the map. Why?

Abstract (arXiv)

Recent advances in multi-modal generative models have enabled significant progress in instruction-based image editing. However, while these models produce visually plausible outputs, their capacity for knowledge-based reasoning editing tasks remains under-explored. In this paper, we introduce KRIS-Bench (Knowledge-based Reasoning in Image-editing Systems Benchmark), a diagnostic benchmark designed to assess models through a cognitively informed lens. Drawing from educational theory, KRIS-Bench categorizes editing tasks across three foundational knowledge types: Factual, Conceptual, and Procedural. Based on this taxonomy, we design 22 representative tasks spanning 7 reasoning dimensions and release 1,267 high-quality annotated editing instances. To support fine-grained evaluation, we propose a comprehensive protocol that incorporates a novel Knowledge Plausibility metric, enhanced by knowledge hints and calibrated through human studies. Empirical results on 10 state-of-the-art models reveal significant gaps in reasoning performance, highlighting the need for knowledge-centric benchmarks to advance the development of intelligent image editing systems.

Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). Builds on 60 of its 75 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

60 of 75 references.

References · 60

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  3. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  4. 2024A Survey on LLM-as-a-Judgecited by 1,423
  5. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  6. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  7. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  8. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  9. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  10. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  11. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  12. 2023Generative Multimodal Models are In-Context Learnerscited by 446
38 more
  1. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  2. 2024OmniGen: Unified Image Generationcited by 394
  3. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
  4. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  5. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  6. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  7. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  8. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  9. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
  10. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  11. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
  12. 2022DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Modelscited by 230
  13. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  14. 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
  15. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 204
  16. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  17. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  18. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 177
  19. 2022SINE: SINgle Image Editing with Text-to-Image Diffusion Modelscited by 159
  20. 2021EditGAN: High-Precision Semantic Image Editingcited by 156
  21. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  22. 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 119
  23. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  24. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
  25. 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
  26. 2022LVOS: A Benchmark for Long-term Video Object Segmentationcited by 77
  27. 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
  28. 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 63
  29. 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methodscited by 54
  30. 2024A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Modelscited by 52
  31. 2025PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Renderingcited by 46
  32. 2025Personalized Generation In Large Model Era: A Surveycited by 45
  33. 2024PromptFix: You Prompt and We Fix the Photocited by 40
  34. 2024FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instructioncited by 36
  35. 2024Learning Action and Reasoning-Centric Image Editing from Videos and Simulationscited by 32
  36. 2024How Far Are We from Intelligent Visual Deductive Reasoning?cited by 29
  37. 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
  38. 2025Generative Multimodal Pretraining with Discrete Diffusion Timestep Tokenscited by 28

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 18; 2026: 53.

71 papers.

Sort:

By area:

  1. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 56
  2. 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?cited by 34
  3. 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 25
  4. 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 25
  5. 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 25
  6. 2025GenExam: A Multidisciplinary Text-to-Image Examcited by 22
  7. 2025Factuality Matters: When Image Generation and Editing Meet Structured Visualscited by 20
  8. 2025PICABench: How Far Are We from Physically Realistic Image Editing?cited by 16
  9. 2026DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editingcited by 14
  10. 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generationcited by 13
  11. 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 13
  12. 2026ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editingcited by 12
38 more
  1. 2026How Well Do Models Follow Visual Instructions? VIBE: A Systematic Benchmark for Visual Instruction-Driven Image Editingcited by 12
  2. 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Modelscited by 12
  3. 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editingcited by 12
  4. 2025WiseEdit: Benchmarking Cognition- and Creativity-Informed Image Editingcited by 11
  5. 2025UnicEdit-10M: A Dataset and Benchmark Breaking the Scale-Quality Barrier via Unified Verification for Reasoning-Enriched Editscited by 10
  6. 2025RePlan: Reasoning-guided Region Planning for Complex Instruction-based Image Editingcited by 10
  7. 2025MMaDA-Parallel: Multimodal Large Diffusion Language Models for Thinking-Aware Editing and Generationcited by 8
  8. 2025TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Renderingcited by 8
  9. 2026UReason: Benchmarking Reasoning-to-Generation Alignment in Unified Multimodal Modelscited by 7
  10. 2026Look Carefully: Adaptive Visual Reinforcements in Multimodal Large Language Models for Hallucination Mitigationcited by 7
  11. 2026GRADE: Benchmarking Discipline-Informed Reasoning in Image Editingcited by 7
  12. 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 6
  13. 2026ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Frameworkcited by 5
  14. 2026GenArena: How Can We Achieve Human-Aligned Evaluation for Visual Generation Tasks?cited by 4
  15. 2026ServImage: An Image Generation and Editing Benchmark from Real-world Commercial Imaging Servicescited by 4
  16. 2026WorldEdit: Towards Open-World Image Editing with a Knowledge-Informed Benchmarkcited by 3
  17. 2026From Statics to Dynamics: Physics-Aware Image Editing with Latent Transition Priorscited by 3
  18. 2026CREval: An Automated Interpretable Evaluation for Creative Image Manipulation under Complex Instructionscited by 3
  19. 2026CAMEO: A Conditional and Quality-Aware Multi-Agent Image Editing Orchestratorcited by 3
  20. 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editingcited by 3
  21. 2026Steering Visual Generation in Unified Multimodal Models with Understanding Supervisioncited by 3
  22. 2026G2TR: Generation-Guided Visual Token Reduction for Separate-Encoder Unified Multimodal Modelscited by 3
  23. 2026Breaking Dual Bottlenecks: Evolving Unified Multimodal Models into Self-Adaptive Interleaved Visual Reasonerscited by 3
  24. 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editingcited by 3
  25. 2026PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editingcited by 3
  26. 2026CPI-Bench: A Comprehensive, Practical and Intelligent Benchmark for Real-World Image Editingcited by 3
  27. 2026VGI-Bench: Probing Visual Intelligence in Video Generation Modelscited by 3
  28. 2025CogniEdit: Dense Gradient Flow Optimization for Fine-Grained Image Editingcited by 2
  29. 2025UmniBench: Unified Understand and Generation Model Oriented Omni-dimensional Benchmarkcited by 2
  30. 2026ViGoR-Bench: How Far Are Visual Generative Models From Zero-Shot Visual Reasoners?cited by 2
  31. 2026PaintBench: Deterministic Evaluation of Precise Visual Editingcited by 2
  32. 2026SymbOmni: Evolving Agentic Omni Models via Symbolic Concept Learningcited by 2
  33. 2026Uncovering Understanding-Generation Synergy in Native Unified Multimodal Models: From Representation, Task to Systemcited by 2
  34. 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learningcited by 2
  35. 2026AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Modelscited by 1
  36. 2026InEdit-Bench: Benchmarking Intermediate Logical Pathways for Intelligent Image Editing Modelscited by 1
  37. 2026VTEdit-Bench: A Comprehensive Benchmark for Multi-Reference Image Editing Models in Virtual Try-Oncited by 1
  38. 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinementcited by 1

50 most cited of 71 All 71 (JSON)