mlsanityData to 14 Oct 2026

Editor's Choice: Evaluating Abstract Intent in Image Editing through Atomic Entity Analysis

arXiv 2605.14842 ↗First posted 14 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Humans naturally communicate through abstract concepts like "mood". However, current image editing benchmarks focus primarily on explicit, literal commands, leaving abstract instructions largely underexplored. In this work, we first formalize the definition and taxonomy of abstract image editing. To measure instruction-following in this challenging domain, we introduce Entity-Rubrics, a framework that breaks down abstract edits into individual, entity-level assessments and achieves strong correlation with human judgment. Alongside this framework, we contribute AbstractEdit, the first benchmark dedicated to abstract image editing across diverse real-world scenes. Evaluating 11 leading models on this dataset reveals a fundamental challenge: standard architectures struggle to balance intent and preservation, commonly defaulting to under-editing or over-editing. Our analysis demonstrates that driving meaningful improvements relies heavily on integrating advanced LLM text encoders and iterative thinking. Looking forward, our entity-based paradigm can generalize beyond assessment to serve as a reward model, enable models to correctly interpret abstract communication, or highlight specific failures in test-time critique loops. Ultimately, we hope this work serves as a stepping stone toward seamless multimodal interaction, closing the gap between rigid machine execution and the natural, open-ended way humans communicate.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 71 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

28 of 71 references.

References · 28

  1. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  2. 2025DINOv3cited by 1,414
  3. 2025Qwen-Image Technical Reportcited by 1,044
  4. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  5. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  6. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  7. 2022The Vendi Score: A Diversity Evaluation Metric for Machine Learningcited by 311
  8. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
  9. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185
  10. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
  11. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  12. 2023TrueTeacher: Learning Factual Consistency Evaluation with Large Language Modelscited by 83
16 more
  1. 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 70
  2. 2024Visual Style Prompting with Swapping Self-Attentioncited by 63
  3. 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 61
  4. 2024Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Modelscited by 43
  5. 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 27
  6. 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editorcited by 25
  7. 2025GIE-Bench: Towards Grounded Evaluation for Text-Guided Image Editingcited by 19
  8. 2025CompBench: Benchmarking Complex Instruction-guided Image Editingcited by 17
  9. 2025PICABench: How Far Are We from Physically Realistic Image Editing?cited by 16
  10. 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoningcited by 9
  11. 2025Beyond Simple Edits: X-Planner for Complex Instruction-Based Image Editingcited by 9
  12. 2022TRUE: Re-evaluating Factual Consistency Evaluationcited by 8
  13. 2024FlexEdit: Marrying Free-Shape Masks to VLLM for Flexible Image Editingcited by 6
  14. 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Modelscited by 4
  15. 2024Specify and Edit: Overcoming Ambiguity in Text-Based Image Editingcited by 2
  16. 2025Re-Thinking the Automatic Evaluation of Image-Text Alignment in Text-to-Image Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026How Well Do Models Follow Visual Instructions? VIBE: A Systematic Benchmark for Visual Instruction-Driven Image Editing
  2. 2026Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
  3. 2025EdiVal-Agent: An Object-Centric Framework for Automated, Fine-Grained Evaluation of Multi-Turn Editing
  4. 2025DreamOmni2: Multimodal Instruction-based Editing and Generation
  5. 2023HIVE: Harnessing Human Feedback for Instructional Visual Editing
  6. 2026CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning
  7. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
  8. 2026GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing