R-Genie: Reasoning-Guided Generative Image Editing
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
While recent advances in image editing have enabled impressive visual synthesis capabilities, current methods remain constrained by explicit textual instructions and limited editing operations, lacking deep comprehension of implicit user intentions and contextual reasoning. In this work, we introduce a new image editing paradigm: reasoning-guided generative editing, which synthesizes images based on complex, multi-faceted textual queries accepting world knowledge and intention inference. To facilitate this task, we first construct a comprehensive dataset featuring over 1,000 image-instruction-edit triples that incorporate rich reasoning contexts and real-world knowledge. We then propose R-Genie: a reasoning-guided generative image editor, which synergizes the generation power of diffusion models with advanced reasoning capabilities of multimodal large language models. R-Genie incorporates a reasoning-attention mechanism to bridge linguistic understanding with visual synthesis, enabling it to handle intricate editing requests involving abstract user intentions and contextual reasoning relations. Extensive experimental results validate that R-Genie can equip diffusion models with advanced reasoning-based editing capabilities, unlocking new potentials for intelligent image synthesis.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 62 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
24 of 62 references.
Closest ancestors · 1
Same direction, newest first
Other references · 23
- 2023GPT-4 Technical Reportcited by 18,396
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 565
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
11 more
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 295
- 2024MM-LLMs: Recent Advances in MultiModal Large Language Modelscited by 278
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185
- 2024The Revolution of Multimodal Large Language Models: A Surveycited by 137
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
- 2025UniToken: Harmonizing Multimodal Understanding and Generation through Unified Visual Encodingcited by 49
- 2025IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Designcited by 36
- 2024Personalizing Multimodal Large Language Models for Image Captioning: An Experimental Analysiscited by 23
- 2024Visual Question Answering Instruction: Unlocking Multimodal Large Language Model To Domain-Specific Visual Multitaskscited by 20
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 25
- 2025ASTRA: Let Arbitrary Subjects Transform in Video Editingcited by 6
- 2026Unified Thinker: A General Reasoning Modular Core for Image Generationcited by 5
- 2026MiLDEdit: Reasoning-Based Multi-Layer Design Document Editingcited by 3
- 2026DeforM: Reasoning-Guided Physics-Aware Video Generation via Spatial-Temporal Maskingcited by 1
- 2026ProductConsistency: Improving Product Identity Preservation in Instruction-Based Image Editing via SFT and RLcited by 0
- 2026DeforM: Reasoning-Guided Physics-Aware Video Generation via Spatial-Temporal Masking21 Jul 2026
- 2026ProductConsistency: Improving Product Identity Preservation in Instruction-Based Image Editing via SFT and RL17 Jun 2026
- 2026MiLDEdit: Reasoning-Based Multi-Layer Design Document Editing8 Jan 2026
- 2026Unified Thinker: A General Reasoning Modular Core for Image Generation6 Jan 2026
- 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmark3 Nov 2025
- 2025ASTRA: Let Arbitrary Subjects Transform in Video Editing1 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Is This Edit Correct? A Multi-Dimensional Benchmark for Reasoning-Aware Image Editing
- 2025Reasoning to Edit: Hypothetical Instruction-Based Image Editing with Visual Reasoning
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
- 2025Understanding-in-Generation: Reinforcing Generative Capability of Unified Model via Infusing Understanding into Generation
- 2025Query-Kontext: An Unified Multimodal Model for Image Generation and Editing
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis
- 2026Generative Visual Chain-of-Thought for Image Editing
- 2025Understanding the Implicit User Intention via Reasoning with Large Language Model for Image Editing