mlsanityData to 7 Oct 2026

ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editing

arXiv 2601.03467 ↗First posted 6 Jan 2026cs.CVcited by 10

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning (RL) has been investigated for improving the quality of image editing, but it faces three key challenges: (1) limited reasoning exploration confined to denoising stochasticity, (2) biased reward fusion, and (3) unstable VLM-based instruction rewards. In this work, we propose ThinkRL-Edit, a reasoning-centric RL framework that decouples visual reasoning from image synthesis and expands reasoning exploration beyond denoising. To the end, we introduce Chain-of-Thought (CoT)-based reasoning sampling with planning and reflection stages prior to generation in online sampling, compelling the model to explore multiple semantic hypotheses and validate their plausibility before committing to a visual outcome. To avoid the failures of weighted aggregation, we propose an unbiased chain preference grouping strategy across multiple reward dimensions. Moreover, we replace interval-based VLM scores with a binary checklist, yielding more precise, lower-variance, and interpretable rewards for complex reasoning. Experiments show our method significantly outperforms prior work on reasoning-centric image editing, producing instruction-faithful, visually coherent, and semantically grounded edits.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 50 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

46 of 50 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
  2. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding9 Jan
  3. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  4. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Models27 Nov
  5. 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models25 Oct
  6. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 40

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2022Flow Matching for Generative Modelingcited by 5,426
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  7. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  9. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  10. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  11. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  12. 2025Qwen-Image Technical Reportcited by 973
28 more
  1. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  2. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  3. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  4. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  5. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  6. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  7. 2025Qwen3-Omni Technical Reportcited by 451
  8. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
  9. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
  10. 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
  11. 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 276
  12. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  13. 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 148
  14. 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
  15. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
  16. 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 88
  17. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 83
  18. 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 78
  19. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
  20. 2025Skywork UniPic 2.0: Building Kontext Model with Online RL for Unified Multimodal Modelcited by 38
  21. 2024PrimeComposer: Faster Progressively Combined Diffusion for Image Composition with Attention Steeringcited by 20
  22. 2025AsFT: Anchoring Safety During LLM Fine-Tuning Within Narrow Safety Basincited by 18
  23. 2024DreamText: High Fidelity Scene Text Synthesiscited by 17
  24. 2024HonestLLM: Toward an Honest and Helpful Large Language Modelcited by 17
  25. 2023Enhancing Object Coherence in Layout-to-Image Synthesiscited by 7
  26. 2024MagicFace: Training-free Universal-Style Human Image Customized Synthesiscited by 7
  27. 2024GCA-3D: Towards Generalized and Consistent Domain Adaptation of 3D Generatorscited by 4
  28. 2023Few-shot Hybrid Domain Adaptation of Image Generatorscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
  2. 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing
  3. 2026Generative Visual Chain-of-Thought for Image Editing
  4. 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Models
  5. 2025R-Genie: Reasoning-Guided Generative Image Editing
  6. 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
  7. 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
  8. 2026Evaluation-Verification Reward for Consistent Multi-Reference Image Editing