GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Unified multimodal models target joint understanding, reasoning, and generation, but current image editing benchmarks are largely confined to natural images and shallow commonsense reasoning, offering limited assessment of this capability under structured, domain-specific constraints. In this work, we introduce GRADE, the first benchmark to assess discipline-informed knowledge and reasoning in image editing. GRADE comprises 520 carefully curated samples across 10 academic domains, spanning from natural science to social science. To support rigorous evaluation, we propose a multi-dimensional evaluation protocol that jointly assesses Discipline Reasoning, Visual Consistency, and Logical Readability. Extensive experiments on 20 state-of-the-art open-source and closed-source models reveal substantial limitations in current models under implicit, knowledge-intensive editing settings, leading to large performance gaps. Beyond quantitative scores, we conduct rigorous analyses and ablations to expose model shortcomings and identify the constraints within disciplinary editing. Together, GRADE pinpoints key directions for the future development of unified multimodal models, advancing the research on discipline-informed image editing and reasoning. Our benchmark and evaluation code are publicly released.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 39 of its 55 references that are in the map. First posted on arXiv 12 Mar 2026.
Builds on
39 of 55 references.
Closest ancestors · 4
Same direction, newest first
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning16 Oct
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation24 Aug
- 2025MMMG: A Massive, Multidisciplinary, Multi-Tier Generation Benchmark for Text-to-Image Reasoning12 Jun
Other references · 35
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Improved Techniques for Training GANscited by 2,938
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2025OpenAI GPT-5 System Cardcited by 910
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
23 more
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024OmniGen: Unified Image Generationcited by 388
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
- 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2024Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-trainingcited by 82
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
- 2024SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Foldingcited by 42
- 2024DreamOmni: Unified Image Generation and Editingcited by 29
- 2025WorldGenBench: A World-Knowledge-Integrated Benchmark for Reasoning-Driven Text-to-Image Generationcited by 20
- 2025GenExam: A Multidisciplinary Text-to-Image Examcited by 19
- 2025SridBench: Benchmark of Scientific Research Illustration Drawing of Image Generation Modelcited by 18
- 2025Mono-InternVL-1.5: Towards Cheaper and Faster Monolithic Multimodal Large Language Modelscited by 13
- 2025Parameter-Inverted Image Pyramid Networks for Visual Perception and Multimodal Understandingcited by 8
- 2024A Survey of Multimodal Composite Editing and Retrievalcited by 5
- 2025UniModel: A Visual-Only Framework for Unified Multimodal Understanding and Generationcited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 4
- 2026Towards Characterizing Scientific Image Utility and Upgradabilitycited by 1
- 2026GeoR-Bench: Evaluating Geoscience Visual Reasoningcited by 0
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editingcited by 0
- 2026RS-RIE-Bench: Benchmarking Reasoning-Guided Remote Sensing Image Editingcited by 0
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning26 Aug 2026
- 2026RS-RIE-Bench: Benchmarking Reasoning-Guided Remote Sensing Image Editing22 Jul 2026
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing2 Jul 2026
- 2026Towards Characterizing Scientific Image Utility and Upgradability2 Jun 2026
- 2026GeoR-Bench: Evaluating Geoscience Visual Reasoning12 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
- 2025GIR-Bench: Versatile Benchmark for Generating Images with Reasoning
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
- 2026Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling
- 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmark
- 2025TextEditBench: Evaluating Reasoning-aware Text Editing Beyond Rendering
- 2026CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning
- 2025Beyond Textual CoT: Interleaved Text-Image Chains with Deep Confidence Reasoning for Image Editing