Refinement Is Inherently Editable: Training-Free Prompt-to-Prompt Image Editing with Generative Refinement Network
Not on the map. Why?
Abstract (arXiv)
Text-guided image editing must introduce the requested changes while preserving unrelated source content. In training-free editing, diffusion editors often use spatial controls whose inaccuracies can leave edits incomplete or alter unrelated regions. Causal autoregressive editors face a further constraint: their fixed decoding order limits revision of earlier decisions. As the first to explore training-free image editing with Generative Refinement Networks (GRN), we observe that its refinement process is inherently suitable for editing and offers a promising way to address these limitations. Motivated by this observation, we introduce RefineEdit, a training-free prompt-to-prompt image editing framework built on the GRN. Our key idea is to couple edit localization with content generation through the global refinement of binary image codes, allowing editing evidence to be revised as the image evolves. More specifically, RefineEdit combines bit routing with two stabilization mechanisms: adaptive spatial freezing and finite bit locking. Bit routing starts from an intermediate source state and uses signed probability differences between the two branches to identify editable positions and bits. It directs selected bits toward editing refinement while anchoring the rest to the evolving source trajectory. Adaptive spatial freezing limits unnecessary expansion of the editing region, while finite bit locking maintains recent bit activations to support continued editing. The overall framework requires no additional training, external masks, or attention control. Across nine editing categories of PIE-Bench, RefineEdit achieves the best background-preservation scores in PSNR, LPIPS, MSE, and SSIM, together with the highest whole-image and edited-region CLIP scores among the evaluated methods. Code is available at https://github.com/mura1n/RefineEdit.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 43 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
38 of 43 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
26 more
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2023Adversarial Diffusion Distillationcited by 759
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 727
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 148
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
- 2023StyleDiffusion: Prompt-Embedding Inversion for Text-Based Editingcited by 68
- 2025Training-Free Text-Guided Image Editing with Visual Autoregressive Modelcited by 21
- 2026ChordEdit: One-Step Low-Energy Transport for Image Editingcited by 18
- 2025Anchor Token Matching: Implicit Structure Locking for Training-free AR Image Editingcited by 10
- 2025EditInfinity: Image Editing with Binary-Quantized Generative Modelscited by 7
- 2026Generative Refinement Networks for Visual Synthesiscited by 3
- 2026Training-free image inversion for one-step diffusion modelscited by 2
- 2026GRNEdit: Efficient General Video Editing from a New Binary-Evidence Perspective in Generative Refinement Networkscited by 2
Built on by
Not cited yet.