mlsanityData to 14 Oct 2026

NEP: Autoregressive Image Editing via Next Editing Token Prediction

arXiv 2508.06044 ↗First posted 8 Aug 2025cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Text-guided image editing involves modifying a source image based on a language instruction and, typically, requires changes to only small local regions. However, existing approaches generate the entire target image rather than selectively regenerate only the intended editing areas. This results in (1) unnecessary computational costs and (2) a bias toward reconstructing non-editing regions, which compromises the quality of the intended edits. To resolve these limitations, we propose to formulate image editing as Next Editing-token Prediction (NEP) based on autoregressive image generation, where only regions that need to be edited are regenerated, thus avoiding unintended modification to the non-editing areas. To enable any-region editing, we propose to pre-train an any-order autoregressive text-to-image (T2I) model. Once trained, it is capable of zero-shot image editing and can be easily adapted to NEP for image editing, which achieves a new state-of-the-art on widely used image editing benchmarks. Moreover, our model naturally supports test-time scaling (TTS) through iteratively refining its generation in a zero-shot manner. The project page is: https://nep-bigai.github.io/

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 53 of its 56 references that are in the map. First posted on arXiv 8 Aug 2025.

Builds on

53 of 56 references.

References · 53

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2023Segment Anythingcited by 8,234
  9. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  10. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  11. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  12. 2022Classifier-Free Diffusion Guidancecited by 5,847
38 more
  1. 2022Generative Adversarial Networkscited by 5,627
  2. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  3. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  6. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  8. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  9. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  12. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  13. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  14. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  15. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  16. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  17. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  18. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
  19. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  20. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  21. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  22. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  23. 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
  24. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  25. 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
  26. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  27. 2024OmniGen: Unified Image Generationcited by 394
  28. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  29. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  30. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  31. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 234
  32. 2024ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Modelscited by 205
  33. 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 173
  34. 2024Randomized Autoregressive Visual Generationcited by 127
  35. 2023Kosmos-G: Generating Images in Context with Multimodal Large Language Modelscited by 105
  36. 2024RandAR: Decoder-only Autoregressive Visual Generation in Random Orderscited by 83
  37. 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflectioncited by 43
  38. 2025EditAR: Unified Conditional Generation with Autoregressive Modelscited by 40

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Training-Free Text-Guided Image Editing with Visual Autoregressive Model
  2. 2025NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scale
  3. 2026Rethinking Structure Preservation in Text-Guided Image Editing with Visual Autoregressive Models
  4. 2025The Promise of RL for Autoregressive Image Editing
  5. 2026Prompt-Guided Image Editing with Masked Logit Nudging in Visual Autoregressive Models
  6. 2025Semantic Context Matters: Improving Conditioning for Autoregressive Models
  7. 2024Specify and Edit: Overcoming Ambiguity in Text-Based Image Editing
  8. 2026ARM: An AutoRegressive Large Multimodal Model with Unified Discrete Representations