mlsanityData to 7 Oct 2026

DialogPaint: A Dialog-based Image Editing Model

arXiv 2303.10073 ↗First posted 17 Mar 2023cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

We introduce DialogPaint, a novel framework that bridges conversational interactions with image editing, enabling users to modify images through natural dialogue. By integrating a dialogue model with the Stable Diffusion image transformation technique, DialogPaint offers a more intuitive and interactive approach to image modifications. Our method stands out by effectively interpreting and executing both explicit and ambiguous instructions, handling tasks such as object replacement, style transfer, and color modification. Notably, DialogPaint supports iterative, multi-round editing, allowing users to refine image edits over successive interactions. Comprehensive evaluations highlight the robustness and versatility of our approach, marking a significant advancement in dialogue-driven image editing.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 40 of its 51 references that are in the map. First posted on arXiv 17 Mar 2023.

Builds on

40 of 51 references.

References · 40

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  7. 2022Training language models to follow instructions with human feedbackcited by 15,712
  8. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  9. 2020Denoising Diffusion Implicit Modelscited by 9,655
  10. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  11. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  12. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
28 more
  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  2. 2022Generative Adversarial Networkscited by 5,603
  3. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  6. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  7. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  9. 2022Emergent Abilities of Large Language Modelscited by 2,483
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  12. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  13. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  14. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  15. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  16. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  17. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  18. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  19. 2020Recipes for building an open-domain chatbotcited by 593
  20. 2020Towards a Human-like Open-Domain Chatbotcited by 467
  21. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  22. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
  23. 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
  24. 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
  25. 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
  26. 2021StyleMC: Multi-Channel Based Fast Text-Guided Image Generation and Manipulationcited by 40
  27. 2017Fine-grained Visual-textual Representation Learningcited by 27
  28. 2022DE-Net: Dynamic Text-guided Image Editing Adversarial Networkscited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 2; 2026: 1.

8 papers.

  1. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  2. 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
  3. 2024Conditional Image Synthesis with Diffusion Models: A Surveycited by 29
  4. 2023Mini-DALLE3: Interactive Text to Image by Prompting Large Language Modelscited by 22
  5. 2025Early Timestep Zero-Shot Candidate Selection for Instruction-Guided Image Editingcited by 5
  6. 2025GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Designcited by 5
  7. 2024DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creationcited by 4
  8. 2026The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialoguecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment
  2. 2026TalkPhoto: A Versatile Training-Free Conversational Assistant for Intelligent Image Editing
  3. 2023ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulation
  4. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
  5. 2025PIXELS: Progressive Image Xemplar-based Editing with Latent Surgery
  6. 2024ChatDiT: A Training-Free Baseline for Task-Agnostic Free-Form Chatting with Diffusion Transformers
  7. 2024Paint by Inpaint: Learning to Add Image Objects by Removing Them First
  8. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models