mlsanityData to 7 Oct 2026

MagicQuill: An Intelligent Interactive Image Editing System

arXiv 2411.09703 ↗First posted 14 Nov 2024cs.CVcited by 30

Not on the map. Why?

Abstract (arXiv)

Image editing involves a variety of complex tasks and requires efficient and precise manipulation techniques. In this paper, we present MagicQuill, an integrated image editing system that enables swift actualization of creative ideas. Our system features a streamlined yet functionally robust interface, allowing for the articulation of editing operations (e.g., inserting elements, erasing objects, altering color) with minimal input. These interactions are monitored by a multimodal large language model (MLLM) to anticipate editing intentions in real time, bypassing the need for explicit prompt entry. Finally, we apply a powerful diffusion prior, enhanced by a carefully learned two-branch plug-in module, to process editing requests with precise control. Experimental results demonstrate the effectiveness of MagicQuill in achieving high-quality image edits. Please visit https://magic-quill.github.io to try out our system.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 72 of its 85 references that are in the map. First posted on arXiv 14 Nov 2024.

Builds on

72 of 85 references.

References · 72

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  8. 2020Denoising Diffusion Implicit Modelscited by 9,655
  9. 2023Visual Instruction Tuningcited by 7,792
  10. 2022Generative Adversarial Networkscited by 5,603
  11. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  12. 2024GPT-4o System Cardcited by 4,467
38 more
  1. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  2. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  3. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  4. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  6. 2015VQA: Visual Question Answeringcited by 2,489
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  8. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  9. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  10. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  11. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  12. 2024OmniGen: Unified Image Generationcited by 388
  13. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  14. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  15. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  16. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 296
  17. 2023Generating Images with Multimodal Language Modelscited by 259
  18. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
  19. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
  20. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  21. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  22. 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 193
  23. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
  24. 2019Gradio: Hassle-Free Sharing and Testing of ML Models in the Wildcited by 176
  25. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
  26. 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 168
  27. 2021Pixel Difference Networks for Efficient Edge Detectioncited by 167
  28. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
  29. 2023Emu: Generative Pretraining in Multimodalitycited by 156
  30. 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
  31. 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
  32. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 132
  33. 2023A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captionscited by 107
  34. 2023Inversion-Free Image Editing with Natural Languagecited by 106
  35. 2019SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Colorcited by 105
  36. 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
  37. 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 100
  38. 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 14; 2026: 13.

30 papers.

Sort:

By area:

  1. 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarkingcited by 35
  2. 2024BrushEdit: All-In-One Image Inpainting and Editingcited by 31
  3. 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
  4. 2025MangaNinja: Line Art Colorization with Precise Reference Followingcited by 17
  5. 2025Hallucination at a Glance: Controlled Visual Edits and Fine-Grained Multimodal Learningcited by 11
  6. 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
  7. 2025Trans-Adapter: A Plug-and-Play Framework for Transparent Image Inpaintingcited by 5
  8. 2025SmartFreeEdit: Mask-Free Spatial-Aware Image Editing with Complex Instruction Understandingcited by 4
  9. 2025MIND-Edit: MLLM Insight-Driven Editing via Language-Vision Projectioncited by 4
  10. 2025Neural-Driven Image Editingcited by 4
  11. 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cuescited by 4
  12. 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
18 more
  1. 2025SPICE: A Synergistic, Precise, Iterative, and Customizable Image Editing Workflowcited by 2
  2. 2025Sketch3DVE: Sketch-based 3D-Aware Scene Video Editingcited by 2
  3. 2024ArtAug: Enhancing Text-to-Image Generation through Synthesis-Understanding Interactioncited by 1
  4. 2025DreamOmni3: Scribble-based Editing and Generationcited by 1
  5. 2026ScribbleSense: Generative Scribble-Based Texture Editing with Intent Predictioncited by 1
  6. 2026EchoGen: Cycle-Consistent Learning for Unified Layout-Image Generation and Understandingcited by 1
  7. 2026Live Interactive Training for Video Segmentationcited by 1
  8. 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Procited by 1
  9. 2026TextWand: A Unified Framework for Scene Text Editingcited by 1
  10. 2025TalkFashion: Intelligent Virtual Try-On Assistant Based on Multimodal Large Language Modelcited by 0
  11. 2025PaintFlow: A Unified Framework for Interactive Oil Paintings Editing and Generationcited by 0
  12. 2025SketchAssist: A Practical Assistant for Semantic Edits and Precise Local Redrawingcited by 0
  13. 2026Design Generative AI for Practitioners: Exploring Interaction Approaches Aligned with Creative Practicecited by 0
  14. 2026Multi-Object Advertisement Creative Generationcited by 0
  15. 2026Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessmentcited by 0
  16. 2026SketchFaceGS: Real-Time Sketch-Driven Face Editing and Generation with Gaussian Splattingcited by 0
  17. 2026ScribbleEdit: Synthetic Data for Image Editing with Scribbles and Textcited by 0
  18. 2026RefGC-SR2: Reference-guided Super-Resolution and Refinement of AI Generated Contentcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editing
  2. 2025Lego-Edit: A General Image Editing Framework with Model-Level Bricks and MLLM Builder
  3. 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Models
  4. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Idea
  5. 2026CREval: An Automated Interpretable Evaluation for Creative Image Manipulation under Complex Instructions
  6. 2025Beyond Simple Edits: X-Planner for Complex Instruction-Based Image Editing
  7. 2026IMAGAgent: Orchestrating Multi-Turn Image Editing via Constraint-Aware Planning and Reflection
  8. 2024TIE: Revolutionizing Text-based Image Editing for Complex-Prompt Following and High-Fidelity Editing