mlsanityData to 14 Oct 2026

Emu Edit: Precise Image Editing via Recognition and Generation Tasks

arXiv 2311.10089 ↗First posted 16 Nov 2023cs.CV cs.AI cs.LGcited by 324

Not on the map. Why?

Cited by 101 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Instruction-based image editing holds immense potential for a variety of applications, as it enables users to perform any editing operation using a natural language instruction. However, current models in this domain often struggle with accurately executing user instructions. We present Emu Edit, a multi-task image editing model which sets state-of-the-art results in instruction-based image editing. To develop Emu Edit we train it to multi-task across an unprecedented range of tasks, such as region-based editing, free-form editing, and Computer Vision tasks, all of which are formulated as generative tasks. Additionally, to enhance Emu Edit's multi-task learning abilities, we provide it with learned task embeddings which guide the generation process towards the correct edit type. Both these elements are essential for Emu Edit's outstanding performance. Furthermore, we show that Emu Edit can generalize to new tasks, such as image inpainting, super-resolution, and compositions of editing tasks, with just a few labeled examples. This capability offers a significant advantage in scenarios where high-quality samples are scarce. Lastly, to facilitate a more rigorous and informed assessment of instructable image editing models, we release a new challenging and versatile benchmark that includes seven different image editing tasks.

Key facts. Cited by 324 papers in the map (data through 14 Oct 2026). Builds on 27 of its 46 references that are in the map. First posted on arXiv 16 Nov 2023.

Builds on

27 of 46 references.

References · 27

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  12. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
15 more
  1. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  2. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  3. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  4. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  5. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
  6. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  7. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 906
  8. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  9. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  10. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
  11. 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 279
  12. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 278
  13. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
  14. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
  15. 2020PP-OCR: A Practical Ultra Lightweight OCR Systemcited by 151

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 7; 2024: 75; 2025: 131; 2026: 111.

324 papers.

Sort:

By area:

  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  2. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  3. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  4. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  5. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  6. 2024OmniGen: Unified Image Generationcited by 394
  7. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
  8. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  9. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  10. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  11. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  12. 2025Video models are zero-shot learners and reasonerscited by 220
38 more
  1. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  2. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  3. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  4. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  5. 2024Consistency Policy: Accelerated Visuomotor Policies via Consistency Distillationcited by 166
  6. 2024In-Context LoRA for Diffusion Transformerscited by 158
  7. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  8. 2023Rich Human Feedback for Text-to-Image Generationcited by 141
  9. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
  10. 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformerscited by 137
  11. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
  12. 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
  13. 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
  14. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  15. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
  16. 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
  17. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
  18. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
  19. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
  20. 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 85
  21. 2024Detecting Multimedia Generated by Large AI Models: A Surveycited by 76
  22. 2024ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertioncited by 71
  23. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 71
  24. 2024ILLUME: Illuminating Your LLMs to See, Draw, and Self-Enhancecited by 64
  25. 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 63
  26. 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editingcited by 62
  27. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  28. 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 61
  29. 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
  30. 2024Meissonic: Revitalizing Masked Generative Transformers for Efficient High-Resolution Text-to-Image Synthesiscited by 56
  31. 2025ILLUME+: Illuminating Unified MLLM with Dual Visual Tokenization and Diffusion Refinementcited by 54
  32. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
  33. 2025SeedEdit 3.0: Fast and High-Quality Generative Image Editingcited by 53
  34. 2024Vitron: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editingcited by 49
  35. 2024Towards Semantic Equivalence of Tokenization in Multimodal LLMcited by 45
  36. 2024Diffusion Model-Based Video Editing: A Surveycited by 44
  37. 2024Add-it: Training-Free Object Insertion in Images With Pretrained Diffusion Modelscited by 43
  38. 2024LinGen: Towards High-Resolution Minute-Length Text-to-Video Generation with Linear Computational Complexitycited by 43

50 most cited of 324 All 324 (JSON)