Inline Critic Steers Image Editing
Not on the map. Why?
Abstract (arXiv)
Instruction-based image editing exhibits heterogeneous difficulty not only across cases but also across regions of an image, motivating refinement approaches that allocate correction to where the model struggles. Existing refinement signals arrive late, after a fully generated image or a completed denoising step. We ask whether such a signal can act within an ongoing forward pass. To investigate this, we probe a frozen image-editing model and find that although generation capability emerges only in the last few layers, the error pattern is already set in early layers (rank correlation rho = 0.83 with the final-layer error map). Based on this, we introduce Inline Critic, a learnable token that critiques a frozen model's predictions at its intermediate layers and steers its hidden states to refine generation during the forward pass. A three-stage recipe is proposed to stabilize the training from learning how to critique to steering generation. As a result, we achieve state of the art on GEdit-Bench (7.89), a +9.4 gain on RISEBench over the same backbone, and the strongest open-source result on KRIS-Bench (81.92, surpassing GPT-4o). We further provide analyses showing that the critic genuinely shapes the model's attention and prediction updates at subsequent layers.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 50 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
43 of 50 references.
References · 43
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
31 more
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
- 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidancecited by 113
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
- 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 97
- 2023ReVersion: Diffusion-Based Relation Inversion from Imagescited by 82
- 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
- 2023ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Modelscited by 75
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 71
- 2022Improved Masked Image Generation with Token-Criticcited by 64
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 64
- 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 61
- 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 56
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 56
- 2025SeedEdit 3.0: Fast and High-Quality Generative Image Editingcited by 53
- 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflectioncited by 43
- 2023BayesDiff: Estimating Pixel-wise Uncertainty in Diffusion via Bayesian Inferencecited by 35
- 2025OpenGPT-4o-Image: A Comprehensive Dataset for Advanced Image Generation and Editingcited by 28
- 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 25
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 25
- 2022DreamArtist++: Controllable One-Shot Text-to-Image Generation via Positive-Negative Adaptercited by 24
- 2024Diffusion Model Guided Sampling with Pixel-Wise Aleatoric Uncertainty Estimationcited by 20
- 2025Feedback Guidance of Diffusion Modelscited by 16
- 2026ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editingcited by 12
- 2026Denoising, Fast and Slow: Difficulty-Aware Adaptive Sampling for Image Generationcited by 5
Built on by
Not cited yet.