RePlan: Reasoning-guided Region Planning for Complex Instruction-based Image Editing
Not on the map. Why?
Abstract (arXiv)
Instruction-based image editing enables natural-language control over visual modifications, yet existing models falter under Instruction-Visual Complexity (IV-Complexity), where intricate instructions meet cluttered or ambiguous scenes. We introduce RePlan (Region-aligned Planning), a plan-then-execute framework that couples a vision-language planner with a diffusion editor. The planner decomposes instructions via step-by-step reasoning and explicitly grounds them to target regions; the editor then applies changes using a training-free attention-region injection mechanism, enabling precise, parallel multi-region edits without iterative inpainting. To strengthen planning, we apply GRPO-based reinforcement learning using 1K instruction-only examples, yielding substantial gains in reasoning fidelity and format reliability. We further present IV-Edit, a benchmark focused on fine-grained grounding and knowledge-intensive edits. Across IV-Complex settings, RePlan consistently outperforms strong baselines trained on far larger datasets, improving regional precision and overall consistency. Our project page: https://replan-iv-edit.github.io
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 27 of its 35 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
27 of 35 references.
References · 27
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
15 more
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 234
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
- 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 180
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026GMO-E2DIT: Grounded Multi-Operation Editing for E-Commerce Imagescited by 3
- 2026Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generationcited by 2
- 2026Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executionscited by 2
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editingcited by 2
- 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibrationcited by 2
- 2026Rethinking Scribble-Guided Image Editing: Generalization, Instruction Adherence, and Multi-Taskingcited by 1
- 2026InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoningcited by 0
- 2026ProductConsistency: Improving Product Identity Preservation in Instruction-Based Image Editing via SFT and RLcited by 0
- 2026Editing Everything Everywhere All at Oncecited by 0
- 2026GMO-E2DIT: Grounded Multi-Operation Editing for E-Commerce Images1 Jul 2026
- 2026Editing Everything Everywhere All at Once30 Jun 2026
- 2026ProductConsistency: Improving Product Identity Preservation in Instruction-Based Image Editing via SFT and RL17 Jun 2026
- 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibration27 May 2026
- 2026Rethinking Scribble-Guided Image Editing: Generalization, Instruction Adherence, and Multi-Tasking25 May 2026
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editing28 Apr 2026
- 2026Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions17 Apr 2026
- 2026InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoning2 Mar 2026
- 2026Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generation12 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Lego-Edit: A General Image Editing Framework with Model-Level Bricks and MLLM Builder
- 2026DARS: Dual-Level Credit Assignment RL with Structured Reasoning for Instruction-Based Image Editing
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
- 2026Instruction-based Image Editing with Planning, Reasoning, and Generation
- 2026PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning
- 2026PrismGPT: Proxy-Guided Learning for Region-Aware Photo Editing with Self-Synthesized Reasoning
- 2026ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editing
- 2025Beyond Simple Edits: X-Planner for Complex Instruction-Based Image Editing