mlsanityData to 14 Oct 2026

Masked Generative Transformer Is What You Need for Image Editing

arXiv 2605.10859 ↗First posted 11 May 2026cs.CV cs.LGcited by 3

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Diffusion models dominate image editing, yet their global denoising mechanism entangles edited regions with surrounding context, causing modifications to propagate into areas that should remain intact. We propose a fundamentally different approach by leveraging Masked Generative Transformers (MGTs), whose localized token-prediction paradigm naturally confines changes to intended regions. We present EditMGT, an MGT-based editing framework that is the first of its kind. Our approach employs multi-layer attention consolidation to aggregate cross-attention maps into precise edit localization signals, and region-hold sampling to explicitly prevent token flipping in non-target areas. To support training, we construct CrispEdit-2M, a 2M-sample high-resolution (>1024) editing dataset spanning seven categories. With only 960M parameters, EditMGT achieves state-of-the-art image similarity on multiple benchmarks while delivering 6x faster editing, demonstrating that MGTs offer a compelling alternative to diffusion-based editing.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 20 of its 23 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

20 of 23 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editing12 Dec
  2. 2025Visual Autoregressive Modeling for Instruction-Guided Image Editing21 Aug
  3. 2024OmniGen: Unified Image Generation17 Sep
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
  5. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov

Other references · 15

  1. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  3. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  4. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
  5. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  6. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  7. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  8. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  9. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  10. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  11. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  12. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
3 more
  1. 2025EditAR: Unified Conditional Generation with Autoregressive Modelscited by 40
  2. 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
  3. 2025NEP: Autoregressive Image Editing via Next Editing Token Predictioncited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale
  2. 2023MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidance
  3. 2025X-Edit: Detecting and Localizing Edits in Images Altered by Text-Guided Diffusion Models
  4. 2026WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing
  5. 2026Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editing
  6. 2025MADI: Masking-Augmented Diffusion with Inference-Time Scaling for Visual Editing
  7. 2024Towards Efficient Diffusion-Based Image Editing with Instant Attention Masks
  8. 2024Vision-guided and Mask-enhanced Adaptive Denoising for Prompt-based Image Editing