Masked Generative Transformer Is What You Need for Image Editing
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion models dominate image editing, yet their global denoising mechanism entangles edited regions with surrounding context, causing modifications to propagate into areas that should remain intact. We propose a fundamentally different approach by leveraging Masked Generative Transformers (MGTs), whose localized token-prediction paradigm naturally confines changes to intended regions. We present EditMGT, an MGT-based editing framework that is the first of its kind. Our approach employs multi-layer attention consolidation to aggregate cross-attention maps into precise edit localization signals, and region-hold sampling to explicitly prevent token flipping in non-target areas. To support training, we construct CrispEdit-2M, a 2M-sample high-resolution (>1024) editing dataset spanning seven categories. With only 960M parameters, EditMGT achieves state-of-the-art image similarity on multiple benchmarks while delivering 6x faster editing, demonstrating that MGTs offer a compelling alternative to diffusion-based editing.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 20 of its 23 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
20 of 23 references.
Closest ancestors · 5
Same direction, newest first
- 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editing12 Dec
- 2025Visual Autoregressive Modeling for Instruction-Guided Image Editing21 Aug
- 2024OmniGen: Unified Image Generation17 Sep
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
Other references · 15
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026MRT: Masked Region Transformer for Layered Image Generation and Editing at Scale
- 2023MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidance
- 2025X-Edit: Detecting and Localizing Edits in Images Altered by Text-Guided Diffusion Models
- 2026WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing
- 2026Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editing
- 2025MADI: Masking-Augmented Diffusion with Inference-Time Scaling for Visual Editing
- 2024Towards Efficient Diffusion-Based Image Editing with Instant Attention Masks
- 2024Vision-guided and Mask-enhanced Adaptive Denoising for Prompt-based Image Editing