mlsanityData to 14 Oct 2026

CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning

arXiv 2603.05518 ↗First posted 31 Jan 2026cs.HC cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Recent advances in large multimodal models (LMMs) have enabled instruction-based image editing, allowing users to modify visual content via natural language descriptions. However, existing approaches often struggle with high-level semantic reasoning and visual consistency, particularly under ambiguous or complex instructions. To address these challenges, we propose CoEditor++, a cognitively structured, training-free framework that decomposes editing into "what to edit" and "how to edit" through two cognitive stages with a reflective self-selection mechanism, enabling robust, fine-grained, and interpretable editing. Built entirely from open-sourced components, CoEditor++ requires no additional training or fine-tuning, ensuring transparency and cross-domain applicability. We evaluate CoEditor++ on SmartEdit, a widely used benchmark for general editing, and AltBear, a privacy and compliance-oriented benchmark. Experimental results show that CoEditor++ achieves state-of-the-art performance in both general editing and responsible editing tasks compared with open-sourced models that require training on specialized editing datasets maintaining significantly higher visual consistency. When compared with closed-source models such as Nano Banana Pro or GPT-4o, CoEditor++ preserves comparable instruction following while still substantially outperforming them in visual consistency. Extensive ablation studies confirm that the effectiveness of CoEditor++ benefits from its structured cognitive design rather than any specific model component. Our findings suggest the potential toward cognitive-centric instruction-based image editing.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 47 of its 52 references that are in the map. First posted on arXiv 31 Jan 2026.

Builds on

47 of 52 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025X2I: Seamless Integration of Multimodal Understanding into Diffusion Transformer via Attention Distillation8 Mar
  2. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Models29 Sep

Other references · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2022Classifier-Free Diffusion Guidancecited by 5,847
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024GPT-4o System Cardcited by 4,588
  8. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  9. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  12. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
33 more
  1. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  2. 2025Qwen-Image Technical Reportcited by 1,044
  3. 2022Diffusion Models in Vision: A Surveycited by 1,015
  4. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
  5. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  6. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  7. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  8. 2024OmniGen: Unified Image Generationcited by 394
  9. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
  10. 2025VAPO: Efficient and Reliable Reinforcement Learning for Advanced Reasoning Taskscited by 285
  11. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
  12. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  13. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  14. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  15. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  16. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
  17. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  18. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  19. 2025Ovis-U1 Technical Reportcited by 67
  20. 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 66
  21. 2025Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoningcited by 49
  22. 2025Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Modelscited by 30
  23. 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoningcited by 28
  24. 2024Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative Editingcited by 21
  25. 2025VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learningcited by 18
  26. 2024InsightEdit: Towards Better Instruction Following for Image Editingcited by 17
  27. 2024Moderator: Moderating Text-to-Image Diffusion Models through Fine-grained Context-based Policiescited by 15
  28. 2023ORES: Open-vocabulary Responsible Visual Synthesiscited by 14
  29. 2025CREA: A Collaborative Multi-Agent Framework for Creative Image Editing and Generationcited by 14
  30. 2025Pixel-Level Reasoning Segmentation via Multi-turn Conversationscited by 7
  31. 2024EditScribe: Non-Visual Image Editing with Natural Language Verification Loopscited by 6
  32. 2024What constitutes a Deep Fake? The blurry line between legitimate processing and manipulation under the EU AI Actcited by 3
  33. 2024Responsible Visual Editingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing
  2. 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
  3. 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Models
  4. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editing
  5. 2025Understanding the Implicit User Intention via Reasoning with Large Language Model for Image Editing
  6. 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
  7. 2026Reasoning-Informed Visual Editing
  8. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models