mlsanityData to 14 Oct 2026

Inline Critic Steers Image Editing

arXiv 2605.12724 ↗First posted 12 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Instruction-based image editing exhibits heterogeneous difficulty not only across cases but also across regions of an image, motivating refinement approaches that allocate correction to where the model struggles. Existing refinement signals arrive late, after a fully generated image or a completed denoising step. We ask whether such a signal can act within an ongoing forward pass. To investigate this, we probe a frozen image-editing model and find that although generation capability emerges only in the last few layers, the error pattern is already set in early layers (rank correlation rho = 0.83 with the final-layer error map). Based on this, we introduce Inline Critic, a learnable token that critiques a frozen model's predictions at its intermediate layers and steers its hidden states to refine generation during the forward pass. A three-stage recipe is proposed to stabilize the training from learning how to critique to steering generation. As a result, we achieve state of the art on GEdit-Bench (7.89), a +9.4 gain on RISEBench over the same backbone, and the strongest open-source result on KRIS-Bench (81.92, surpassing GPT-4o). We further provide analyses showing that the critic genuinely shapes the model's attention and prediction updates at subsequent layers.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 50 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

43 of 50 references.

References · 43

  1. 2022Flow Matching for Generative Modelingcited by 5,702
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  7. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  8. 2025Qwen-Image Technical Reportcited by 1,044
  9. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  11. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  12. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
31 more
  1. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  2. 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
  3. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  4. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  5. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  6. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  7. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  8. 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
  9. 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidancecited by 113
  10. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 99
  11. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 97
  12. 2023ReVersion: Diffusion-Based Relation Inversion from Imagescited by 82
  13. 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 79
  14. 2023ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Modelscited by 75
  15. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 71
  16. 2022Improved Masked Image Generation with Token-Criticcited by 64
  17. 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 64
  18. 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 61
  19. 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 56
  20. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 56
  21. 2025SeedEdit 3.0: Fast and High-Quality Generative Image Editingcited by 53
  22. 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflectioncited by 43
  23. 2023BayesDiff: Estimating Pixel-wise Uncertainty in Diffusion via Bayesian Inferencecited by 35
  24. 2025OpenGPT-4o-Image: A Comprehensive Dataset for Advanced Image Generation and Editingcited by 28
  25. 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 25
  26. 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 25
  27. 2022DreamArtist++: Controllable One-Shot Text-to-Image Generation via Positive-Negative Adaptercited by 24
  28. 2024Diffusion Model Guided Sampling with Pixel-Wise Aleatoric Uncertainty Estimationcited by 20
  29. 2025Feedback Guidance of Diffusion Modelscited by 16
  30. 2026ThinkRL-Edit: Thinking in Reinforcement Learning for Reasoning-Centric Image Editingcited by 12
  31. 2026Denoising, Fast and Slow: Difficulty-Aware Adaptive Sampling for Image Generationcited by 5

Built on by

Not cited yet.