Generative Visual Chain-of-Thought for Image Editing
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Existing image editing methods struggle to perceive where to edit, especially under complex scenes and nuanced spatial instructions. To address this issue, we propose Generative Visual Chain-of-Thought (GVCoT), a unified framework that performs native visual reasoning by first generating spatial cues to localize the target region and then executing the edit. Unlike prior text-only CoT or tool-dependent visual CoT paradigms, GVCoT jointly optimizes visual tokens generated during the reasoning and editing phases in an end-to-end manner. This way fosters the emergence of innate spatial reasoning ability and enables more effective utilization of visual-domain cues. The main challenge of training GCVoT lies in the scarcity of large-scale editing data with precise edit region annotations; to this end, we construct GVCoT-Edit-Instruct, a dataset of 1.8M high-quality samples spanning 19 tasks. We adopt a progressive training strategy: supervised fine-tuning to build foundational localization ability in reasoning trace before final editing, followed by reinforcement learning to further improve reasoning and editing quality. Finally, we introduce SREdit-Bench, a new benchmark designed to comprehensively stress-test models under sophisticated scenes and fine-grained referring expressions. Experiments demonstrate that GVCoT consistently outperforms state-of-the-art models on SREdit-Bench and ImgEdit. We hope our GVCoT will inspire future research toward interpretable and precise image editing.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 53 of its 152 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
53 of 152 references.
Closest ancestors · 17
Same direction, newest first
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoning16 Oct
- 2025Beyond Textual CoT: Interleaved Text-Image Chains with Deep Confidence Reasoning for Image Editing9 Oct
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting4 Sep
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
- 2025VGR: Visual Grounded Reasoning13 Jun
- 2025Thinking with Generated Images28 May
- 2025Thinking with Visual Abstract: Enhancing Multimodal Reasoning via Visual Abstraction26 May
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning22 May
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thought21 May
- 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
5 more
- 2025UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learning20 May
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing13 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
- 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding9 Jan
Other references · 36
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
24 more
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025Seed1.5-VL Technical Reportcited by 367
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
- 2025Ovis-U1 Technical Reportcited by 65
- 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generationcited by 64
- 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
- 2025SeedEdit 3.0: Fast and High-Quality Generative Image Editingcited by 52
- 2025BLIP3o-NEXT: Next Frontier of Native Image Generationcited by 50
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
- 2025Ming-UniVision: Joint Image Understanding and Generation with a Unified Continuous Tokenizercited by 27
- 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 25
- 2025ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependenciescited by 20
- 2025VINCIE: Unlocking In-context Image Editing from Videocited by 17
- 2025Query-Kontext: An Unified Multimodal Model for Image Generation and Editingcited by 15
- 2025CompBench: Benchmarking Complex Instruction-guided Image Editingcited by 14
- 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projectioncited by 4
- 2025Lego-Edit: A General Image Editing Framework with Model-Level Bricks and MLLM Buildercited by 4
- 2025CAMILA: Context-Aware Masking for Image Editing with Language Alignmentcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editing
- 2025R-Genie: Reasoning-Guided Generative Image Editing
- 2026Instruction-based Image Editing with Planning, Reasoning, and Generation
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editing
- 2026Probing Visual Planning in Image Editing Models
- 2026Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generation
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
- 2024EVLM: Self-Reflective Multimodal Reasoning for Cross-Dimensional Visual Editing