NEP: Autoregressive Image Editing via Next Editing Token Prediction
Not on the map. Why?
Abstract (arXiv)
Text-guided image editing involves modifying a source image based on a language instruction and, typically, requires changes to only small local regions. However, existing approaches generate the entire target image rather than selectively regenerate only the intended editing areas. This results in (1) unnecessary computational costs and (2) a bias toward reconstructing non-editing regions, which compromises the quality of the intended edits. To resolve these limitations, we propose to formulate image editing as Next Editing-token Prediction (NEP) based on autoregressive image generation, where only regions that need to be edited are regenerated, thus avoiding unintended modification to the non-editing areas. To enable any-region editing, we propose to pre-train an any-order autoregressive text-to-image (T2I) model. Once trained, it is capable of zero-shot image editing and can be easily adapted to NEP for image editing, which achieves a new state-of-the-art on widely used image editing benchmarks. Moreover, our model naturally supports test-time scaling (TTS) through iteratively refining its generation in a zero-shot manner. The project page is: https://nep-bigai.github.io/
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 53 of its 56 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
53 of 56 references.
References · 53
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023Segment Anythingcited by 8,234
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Classifier-Free Diffusion Guidancecited by 5,847
38 more
- 2022Generative Adversarial Networkscited by 5,627
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2024OmniGen: Unified Image Generationcited by 394
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
- 2024ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Modelscited by 205
- 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 173
- 2024Randomized Autoregressive Visual Generationcited by 127
- 2023Kosmos-G: Generating Images in Context with Multimodal Large Language Modelscited by 105
- 2024RandAR: Decoder-only Autoregressive Visual Generation in Random Orderscited by 83
- 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflectioncited by 43
- 2025EditAR: Unified Conditional Generation with Autoregressive Modelscited by 40
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 2.
5 papers.
- 2025Visual Autoregressive Modeling for Instruction-Guided Image Editingcited by 22
- 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editingcited by 12
- 2025MILR: Improving Multimodal Image Generation via Test-Time Latent Reasoningcited by 8
- 2026Masked Generative Transformer Is What You Need for Image Editingcited by 3
- 2026Intermediate Text Representation Guided Text-to-Image Generation for Enhancing One-and-Only Alignmentcited by 0
- 2026Intermediate Text Representation Guided Text-to-Image Generation for Enhancing One-and-Only Alignment29 Jun 2026
- 2026Masked Generative Transformer Is What You Need for Image Editing11 May 2026
- 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editing12 Dec 2025
- 2025MILR: Improving Multimodal Image Generation via Test-Time Latent Reasoning26 Sep 2025
- 2025Visual Autoregressive Modeling for Instruction-Guided Image Editing21 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025Training-Free Text-Guided Image Editing with Visual Autoregressive Model
- 2025NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scale
- 2026Rethinking Structure Preservation in Text-Guided Image Editing with Visual Autoregressive Models
- 2025The Promise of RL for Autoregressive Image Editing
- 2026Prompt-Guided Image Editing with Masked Logit Nudging in Visual Autoregressive Models
- 2025Semantic Context Matters: Improving Conditioning for Autoregressive Models
- 2024Specify and Edit: Overcoming Ambiguity in Text-Based Image Editing
- 2026ARM: An AutoRegressive Large Multimodal Model with Unified Discrete Representations