CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
Abstract (arXiv)
Recent advances in large multimodal models (LMMs) have enabled instruction-based image editing, allowing users to modify visual content via natural language descriptions. However, existing approaches often struggle with high-level semantic reasoning and visual consistency, particularly under ambiguous or complex instructions. To address these challenges, we propose CoEditor++, a cognitively structured, training-free framework that decomposes editing into "what to edit" and "how to edit" through two cognitive stages with a reflective self-selection mechanism, enabling robust, fine-grained, and interpretable editing. Built entirely from open-sourced components, CoEditor++ requires no additional training or fine-tuning, ensuring transparency and cross-domain applicability. We evaluate CoEditor++ on SmartEdit, a widely used benchmark for general editing, and AltBear, a privacy and compliance-oriented benchmark. Experimental results show that CoEditor++ achieves state-of-the-art performance in both general editing and responsible editing tasks compared with open-sourced models that require training on specialized editing datasets maintaining significantly higher visual consistency. When compared with closed-source models such as Nano Banana Pro or GPT-4o, CoEditor++ preserves comparable instruction following while still substantially outperforming them in visual consistency. Extensive ablation studies confirm that the effectiveness of CoEditor++ benefits from its structured cognitive design rather than any specific model component. Our findings suggest the potential toward cognitive-centric instruction-based image editing.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 47 of its 52 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
47 of 52 references.
Closest ancestors · 2
Same direction, newest first
- 2025X2I: Seamless Integration of Multimodal Understanding into Diffusion Transformer via Attention Distillation8 Mar
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Models29 Sep
Other references · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023Visual Instruction Tuningcited by 7,869
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
33 more
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2025Qwen-Image Technical Reportcited by 1,044
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024OmniGen: Unified Image Generationcited by 394
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
- 2025VAPO: Efficient and Reliable Reinforcement Learning for Advanced Reasoning Taskscited by 285
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 164
- 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2025Ovis-U1 Technical Reportcited by 67
- 2025Ming-Omni: A Unified Multimodal Model for Perception and Generationcited by 66
- 2025Skywork R1V2: Multimodal Hybrid Reinforcement Learning for Reasoningcited by 49
- 2025Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Modelscited by 30
- 2025PixelThink: Towards Efficient Chain-of-Pixel Reasoningcited by 28
- 2024Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative Editingcited by 21
- 2025VIKI-R: Coordinating Embodied Multi-Agent Cooperation via Reinforcement Learningcited by 18
- 2024InsightEdit: Towards Better Instruction Following for Image Editingcited by 17
- 2024Moderator: Moderating Text-to-Image Diffusion Models through Fine-grained Context-based Policiescited by 15
- 2023ORES: Open-vocabulary Responsible Visual Synthesiscited by 14
- 2025CREA: A Collaborative Multi-Agent Framework for Creative Image Editing and Generationcited by 14
- 2025Pixel-Level Reasoning Segmentation via Multi-turn Conversationscited by 7
- 2024EditScribe: Non-Visual Image Editing with Natural Language Verification Loopscited by 6
- 2024What constitutes a Deep Fake? The blurry line between legitimate processing and manipulation under the EU AI Actcited by 3
- 2024Responsible Visual Editingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing
- 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Models
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editing
- 2025Understanding the Implicit User Intention via Reasoning with Large Language Model for Image Editing
- 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
- 2026Reasoning-Informed Visual Editing
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models