ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editing
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning (RL) has been investigated for improving the quality of image editing, but it faces three key challenges: (1) limited reasoning exploration confined to denoising stochasticity, (2) biased reward fusion, and (3) unstable VLM-based instruction rewards. In this work, we propose ThinkRL-Edit, a reasoning-centric RL framework that decouples visual reasoning from image synthesis and expands reasoning exploration beyond denoising. To the end, we introduce Chain-of-Thought (CoT)-based reasoning sampling with planning and reflection stages prior to generation in online sampling, compelling the model to explore multiple semantic hypotheses and validate their plausibility before committing to a visual outcome. To avoid the failures of weighted aggregation, we propose an unbiased chain preference grouping strategy across multiple reward dimensions. Moreover, we replace interval-based VLM scores with a binary checklist, yielding more precise, lower-variance, and interpretable rewards for complex reasoning. Experiments show our method significantly outperforms prior work on reasoning-centric image editing, producing instruction-faithful, visually coherent, and semantically grounded edits.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 50 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
46 of 50 references.
Closest ancestors · 6
Same direction, newest first
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
- 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding9 Jan
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Models27 Nov
- 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models25 Oct
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
Other references · 40
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2025Qwen-Image Technical Reportcited by 973
28 more
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2025Qwen3-Omni Technical Reportcited by 451
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
- 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 276
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 148
- 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 88
- 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 83
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 78
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
- 2025Skywork UniPic 2.0: Building Kontext Model with Online RL for Unified Multimodal Modelcited by 38
- 2024PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steeringcited by 20
- 2025AsFT: Anchoring Safety During LLM Fine-Tuning Within Narrow Safety Basincited by 18
- 2024DreamText: High Fidelity Scene Text Synthesiscited by 17
- 2024HonestLLM: Toward an Honest and Helpful Large Language Modelcited by 17
- 2023Enhancing Object Coherence in Layout-to-Image Synthesiscited by 7
- 2024MagicFace: Training-free Universal-Style Human Image Customized Synthesiscited by 7
- 2024GCA-3D: Towards Generalized and Consistent Domain Adaptation of 3D Generatorscited by 4
- 2023Few-shot Hybrid Domain Adaptation of Image Generatorscited by 2
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026GMO-E2DIT: Grounded Multi-Operation Editing for E-Commerce Imagescited by 3
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editingcited by 2
- 2026InterleaveThinker: Reinforcing Agentic Interleaved Generationcited by 2
- 2026Advances in GRPO for Generation Models: A Surveycited by 1
- 2026PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editingcited by 1
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesiscited by 1
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editingcited by 0
- 2026Inline Critic Steers Image Editingcited by 0
- 2026STBridge: Shared-Target Alignment for Bridging Understanding and Generation in UMMscited by 0
- 2026Reasoning-Informed Visual Editingcited by 0
- 2026Reasoning-Informed Visual Editing8 Oct 2026
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis21 Jul 2026
- 2026STBridge: Shared-Target Alignment for Bridging Understanding and Generation in UMMs19 Jul 2026
- 2026GMO-E2DIT: Grounded Multi-Operation Editing for E-Commerce Images1 Jul 2026
- 2026PhyEditBench: A Real-World Multi-Stage Benchmark for Physics-Aware Image Editing25 Jun 2026
- 2026InterleaveThinker: Reinforcing Agentic Interleaved Generation11 Jun 2026
- 2026Inline Critic Steers Image Editing12 May 2026
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editing28 Apr 2026
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing21 Apr 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
- 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing
- 2026Generative Visual Chain-of-Thought for Image Editing
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Models
- 2025R-Genie: Reasoning-Guided Generative Image Editing
- 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
- 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
- 2026Evaluation-Verification Reward for Consistent Multi-Reference Image Editing