mlsanityData to 14 Oct 2026

Interactive Sketch & Fill: Multiclass Sketch-to-Image Translation

arXiv 1909.11081 ↗First posted 24 Sep 2019cs.CV cs.LG eess.IVcited by 51

Not on the map. Why?

Abstract (arXiv)

We propose an interactive GAN-based sketch-to-image translation method that helps novice users create images of simple objects. As the user starts to draw a sketch of a desired object type, the network interactively recommends plausible completions, and shows a corresponding synthesized image to the user. This enables a feedback loop, where the user can edit their sketch based on the network's recommendations, visualizing both the completed shape and final rendered image while they draw. In order to use a single trained model across a wide array of object classes, we introduce a gating-based approach for class conditioning, which allows us to generate distinct classes without feature mixing, from a single generator network. Video available at our website: https://arnabgho.github.io/iSketchNFill/.

Key facts. Cited by 51 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Sep 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 13; 2022: 13; 2023: 12; 2024: 6; 2025: 6; 2026: 1.

51 papers.

Sort:

By area:

  1. 2021GAN Inversion: A Surveycited by 367
  2. 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
  3. 2021Multimodal Conditional Image Synthesis with Product-of-Experts GANscited by 75
  4. 20223DALL-E: Integrating Text-to-Image AI in 3D Design Workflowscited by 41
  5. 2021M6-UFC: Unifying Multi-Modal Controls for Conditional Image Synthesis via Non-Autoregressive Generative Transformerscited by 36
  6. 2025IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Designcited by 36
  7. 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketchescited by 34
  8. 2021SketchEdit: Mask-Free Local Image Manipulation with Partial Sketchescited by 33
  9. 2022Probabilistic Compositional Embeddings for Multimodal Image Retrievalcited by 29
  10. 2024It's All About Your Sketch: Democratising Sketch Control in Diffusion Modelscited by 29
  11. 2022Sketching without Worrying: Noise-Tolerant Sketch-Based Image Retrievalcited by 27
  12. 2023MaskSketch: Unpaired Structure-guided Masked Image Generationcited by 27
38 more
  1. 2021Towards Open-World Text-Guided Face Image Generation and Manipulationcited by 25
  2. 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
  3. 2021Adversarial Open Domain Adaptation for Sketch-to-Photo Synthesiscited by 24
  4. 2024ScribbleLight: Single Image Indoor Relighting with Scribblescited by 24
  5. 2022Partially Does It: Towards Scene-Level FG-SBIR with Partial Inputcited by 20
  6. 2023SmartMask: Context Aware High-Fidelity Mask Generation for Fine-grained Object Insertion and Layout Controlcited by 18
  7. 2023Sketch2Saliency: Learning to Detect Salient Objects from Human Drawingscited by 17
  8. 2022CoGS: Controllable Generation and Search from Sketch and Stylecited by 14
  9. 2021Facial-Sketch Synthesis: A New Challengecited by 13
  10. 2023DiffSketching: Sketch Control Image Synthesis with Diffusion Modelscited by 10
  11. 2021Conditional Temporal Variational AutoEncoder for Action Video Predictioncited by 9
  12. 2021One Sketch for All: One-Shot Personalized Sketch Segmentationcited by 9
  13. 2021dualFace:Two-Stage Drawing Guidance for Freehand Portrait Sketchingcited by 8
  14. 2021Deep Image Synthesis from Intuitive User Input: A Review and Perspectivescited by 8
  15. 2022Image Search with Text Feedback by Additive Attention Compositional Learningcited by 7
  16. 2023AniFaceDrawing: Anime Portrait Exploration during Your Sketchingcited by 7
  17. 2025LOTS of Fashion! Multi-Conditioning for Image Generation via Sketch-Text Pairingcited by 7
  18. 2022Paint2Pix: Interactive Painting based Progressive Image Synthesis and Editingcited by 6
  19. 2022DeepPortraitDrawing: Generating Human Body Images from Freehand Sketchescited by 5
  20. 2024LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Modelcited by 5
  21. 2022BOSS: Bottom-up Cross-modal Semantic Composition with Hybrid Counterfactual Training for Robust Content-based Image Retrievalcited by 4
  22. 2022Unsupervised Scene Sketch to Photo Synthesiscited by 4
  23. 2025SketchFusion: Learning Universal Sketch Features through Fusing Foundation Modelscited by 4
  24. 2021ACNet: Approaching-and-Centralizing Network for Zero-Shot Sketch-Based Image Retrievalcited by 3
  25. 2023Towards Flexible, Scalable, and Adaptive Multi-Modal Conditioned Face Synthesiscited by 3
  26. 2023Inversion-by-Inversion: Exemplar-based Sketch-to-Photo Synthesis via Stochastic Differential Equations without Trainingcited by 2
  27. 2024U-Sketch: An Efficient Approach for Sketch to Image Diffusion Modelscited by 2
  28. 2021Adversarial Open Domain Adaption Framework (AODA): Sketch-to-Photo Synthesiscited by 1
  29. 2022A Creative Industry Image Generation Dataset Based on Captionscited by 1
  30. 2023Interactive Neural Paintingcited by 1
  31. 2023Collaborative Neural Paintingcited by 1
  32. 2024Artistic Intelligence: A Diffusion-Based Framework for High-Fidelity Landscape Painting Synthesiscited by 1
  33. 2022Semantics-Preserving Sketch Embedding for Face Generationcited by 0
  34. 2023Text-Guided Scene Sketch-to-Photo Synthesiscited by 0
  35. 2024Thing2Reality: Transforming 2D Content into Conditioned Multiviews and 3D Gaussian Objects for XR Communicationcited by 0
  36. 2025Prompt-Guided Attention Head Selection for Focus-Oriented Image Retrievalcited by 0
  37. 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detectioncited by 0
  38. 2025Interactive Drawing Guidance for Anime Illustrations with Diffusion Modelcited by 0

50 most cited of 51 All 51 (JSON)