Creative Sketch Generation
Not on the map. Why?
Abstract (arXiv)
Sketching or doodling is a popular creative activity that people engage in. However, most existing work in automatic sketch understanding or generation has focused on sketches that are quite mundane. In this work, we introduce two datasets of creative sketches -- Creative Birds and Creative Creatures -- containing 10k sketches each along with part annotations. We propose DoodlerGAN -- a part-based Generative Adversarial Network (GAN) -- to generate unseen compositions of novel part appearances. Quantitative evaluations as well as human studies demonstrate that sketches generated by our approach are more creative and of higher quality than existing approaches. In fact, in Creative Birds, subjects prefer sketches generated by DoodlerGAN over those drawn by humans! Our code can be found at https://github.com/facebookresearch/DoodlerGAN and a demo can be found at http://doodlergan.cloudcv.org.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 10; 2024: 8; 2025: 9; 2026: 5.
44 papers.
Sort:
By area:
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2022CLIPascene: Scene Sketching with Different Types and Levels of Abstractioncited by 63
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Modelscited by 54
- 2022FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Contextcited by 47
- 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 30
- 2024CodeS: Natural Language to Code Repository via Multi-Layer Sketchcited by 28
- 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraintscited by 25
- 2022Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketchescited by 23
- 2021The Animation Transformer: Visual Correspondence via Segment Matchingcited by 20
- 2022Partially Does It: Towards Scene-Level FG-SBIR with Partial Inputcited by 20
- 2021DoodleFormer: Creative Sketch Drawing with Transformerscited by 17
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypointscited by 17
32 more
- 2023Sketch2Saliency: Learning to Detect Salient Objects from Human Drawingscited by 17
- 2024Can AI Be as Creative as Humans?cited by 17
- 2023TP2O: Creative Text Pair-to-Object Generation using Balance Swap-Samplingcited by 16
- 2023ChiroDiff: Modelling chirographic data with Diffusion Modelscited by 14
- 2024SketchINR: A First Look into Sketches as Implicit Neural Representationscited by 13
- 2024PartCraft: Crafting Creative Objects by Partscited by 13
- 2022Improving Fairness in Image Classification via Sketchingcited by 11
- 2023SketchXAI: A First Look at Explainability for Human Sketchescited by 10
- 2023SketchDreamer: Interactive Text-Augmented Creative Sketch Ideationcited by 10
- 2021One Sketch for All: One-Shot Personalized Sketch Segmentationcited by 9
- 2023ContextSeg: Sketch Semantic Segmentation by Querying the Context with Attentioncited by 9
- 2024Freehand Sketch Generation from Mechanical Componentscited by 8
- 2023DreamCreature: Crafting Photorealistic Virtual Creatures from Imaginationcited by 5
- 2025Instance Segmentation of Scene Sketches Using Natural Image Priorscited by 4
- 2023ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schr"odinger Bridgecited by 3
- 2021Calliar: An Online Handwritten Dataset for Arabic Calligraphycited by 2
- 2024Do Generalised Classifiers really work on Human Drawn Sketches?cited by 2
- 2025StrokeFusion: Vector Sketch Generation via Joint Stroke-UDF Encoding and Latent Sequence Diffusioncited by 2
- 2026VideoSketcher: Sequential Sketch Generation Using Video Model Priorscited by 2
- 2021XCI-Sketch: Extraction of Color Information from Images for Generation of Colored Outlines and Sketchescited by 1
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generationcited by 1
- 2025Sketch & Paint: Stroke-by-Stroke Evolution of Visual Artworkscited by 1
- 2025Sparse-to-Sparse Training of Diffusion Modelscited by 1
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketchingcited by 1
- 2022Multimodal Query-guided Object Localizationcited by 0
- 2025FedGAI: Federated Style Learning with Cloud-Edge Collaboration for Generative AI in Fashion Designcited by 0
- 2025ViSketch-GPT: Collaborative Multi-Scale Feature Extraction for Sketch Recognition and Generationcited by 0
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detectioncited by 0
- 2025Annotation-Free Human Sketch Quality Assessmentcited by 0
- 2026SketchMamba: A Lightweight State-Space Model for Joint Progressive Sketch Classification and Stroke Auto-Completioncited by 0
- 2026Draw This Firstcited by 0
- 2026SketchFlow: Zero-Shot Vector Sketch Generation via GMM Prior Flow in CLIP Latent Spacecited by 0
- 2026SketchFlow: Zero-Shot Vector Sketch Generation via GMM Prior Flow in CLIP Latent Space21 Aug 2026
- 2026Draw This First12 Aug 2026
- 2026SketchMamba: A Lightweight State-Space Model for Joint Progressive Sketch Classification and Stroke Auto-Completion26 Jul 2026
- 2026VideoSketcher: Sequential Sketch Generation Using Video Model Priors17 Feb 2026
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketching12 Feb 2026
- 2025Annotation-Free Human Sketch Quality Assessment28 Jul 2025
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection10 Jul 2025
- 2025Sparse-to-Sparse Training of Diffusion Models30 Apr 2025
- 2025StrokeFusion: Vector Sketch Generation via Joint Stroke-UDF Encoding and Latent Sequence Diffusion31 Mar 2025
- 2025ViSketch-GPT: Collaborative Multi-Scale Feature Extraction for Sketch Recognition and Generation28 Mar 2025
- 2025FedGAI: Federated Style Learning with Cloud-Edge Collaboration for Generative AI in Fashion Design16 Mar 2025
- 2025Sketch & Paint: Stroke-by-Stroke Evolution of Visual Artworks27 Feb 2025
32 more
- 2025Instance Segmentation of Scene Sketches Using Natural Image Priors13 Feb 2025
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation7 Jan 2025
- 2024SketchAgent: Language-Driven Sequential Sketch Generation26 Nov 2024
- 2024Freehand Sketch Generation from Mechanical Components12 Aug 2024
- 2024Building Machines that Learn and Think with People22 Jul 2024
- 2024PartCraft: Crafting Creative Objects by Parts5 Jul 2024
- 2024Do Generalised Classifiers really work on Human Drawn Sketches?4 Jul 2024
- 2024CodeS: Natural Language to Code Repository via Multi-Layer Sketch25 Mar 2024
- 2024SketchINR: A First Look into Sketches as Implicit Neural Representations14 Mar 2024
- 2024Can AI Be as Creative as Humans?3 Jan 2024
- 2023ContextSeg: Sketch Semantic Segmentation by Querying the Context with Attention28 Nov 2023
- 2023DreamCreature: Crafting Photorealistic Virtual Creatures from Imagination27 Nov 2023
- 2023ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schr"odinger Bridge24 Nov 2023
- 2023TP2O: Creative Text Pair-to-Object Generation using Balance Swap-Sampling3 Oct 2023
- 2023SketchDreamer: Interactive Text-Augmented Creative Sketch Ideation27 Aug 2023
- 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraints3 Aug 2023
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Models26 Jun 2023
- 2023SketchXAI: A First Look at Explainability for Human Sketches23 Apr 2023
- 2023ChiroDiff: Modelling chirographic data with Diffusion Models7 Apr 2023
- 2023Sketch2Saliency: Learning to Detect Salient Objects from Human Drawings20 Mar 2023
- 2022Multimodal Query-guided Object Localization1 Dec 2022
- 2022CLIPascene: Scene Sketching with Different Types and Levels of Abstraction30 Nov 2022
- 2022Improving Fairness in Image Classification via Sketching31 Oct 2022
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypoints21 May 2022
- 2022Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketches28 Mar 2022
- 2022Partially Does It: Towards Scene-Level FG-SBIR with Partial Input28 Mar 2022
- 2022FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Context4 Mar 2022
- 2021One Sketch for All: One-Shot Personalized Sketch Segmentation20 Dec 2021
- 2021DoodleFormer: Creative Sketch Drawing with Transformers6 Dec 2021
- 2021The Animation Transformer: Visual Correspondence via Segment Matching6 Sep 2021
- 2021XCI-Sketch: Extraction of Color Information from Images for Generation of Colored Outlines and Sketches26 Aug 2021
- 2021Calliar: An Online Handwritten Dataset for Arabic Calligraphy20 Jun 2021
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Modelscited by 54
- 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraintscited by 25
- 2023ChiroDiff: Modelling chirographic data with Diffusion Modelscited by 14
- 2023SketchDreamer: Interactive Text-Augmented Creative Sketch Ideationcited by 10
- 2023ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schr"odinger Bridgecited by 3
- 2026VideoSketcher: Sequential Sketch Generation Using Video Model Priorscited by 2
- 2025Sparse-to-Sparse Training of Diffusion Modelscited by 1
- 2026SketchFlow: Zero-Shot Vector Sketch Generation via GMM Prior Flow in CLIP Latent Spacecited by 0
- 2026SketchFlow: Zero-Shot Vector Sketch Generation via GMM Prior Flow in CLIP Latent Space21 Aug 2026
- 2026VideoSketcher: Sequential Sketch Generation Using Video Model Priors17 Feb 2026
- 2025Sparse-to-Sparse Training of Diffusion Models30 Apr 2025
- 2023ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schr"odinger Bridge24 Nov 2023
- 2023SketchDreamer: Interactive Text-Augmented Creative Sketch Ideation27 Aug 2023
- 2023ConceptLab: Creative Concept Generation using VLM-Guided Diffusion Prior Constraints3 Aug 2023
- 2023DiffSketcher: Text Guided Vector Sketch Synthesis through Latent Diffusion Models26 Jun 2023
- 2023ChiroDiff: Modelling chirographic data with Diffusion Models7 Apr 2023
- 2024Building Machines that Learn and Think with Peoplecited by 73
- 2022CLIPascene: Scene Sketching with Different Types and Levels of Abstractioncited by 63
- 2022FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Contextcited by 47
- 2024SketchAgent: Language-Driven Sequential Sketch Generationcited by 30
- 2024CodeS: Natural Language to Code Repository via Multi-Layer Sketchcited by 28
- 2022Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketchescited by 23
- 2021The Animation Transformer: Visual Correspondence via Segment Matchingcited by 20
- 2022Partially Does It: Towards Scene-Level FG-SBIR with Partial Inputcited by 20
- 2021DoodleFormer: Creative Sketch Drawing with Transformerscited by 17
- 2022AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypointscited by 17
- 2023Sketch2Saliency: Learning to Detect Salient Objects from Human Drawingscited by 17
- 2024Can AI Be as Creative as Humans?cited by 17
12 most cited of 36 All 36 (JSON)
- 2026Draw This First12 Aug 2026
- 2026SketchMamba: A Lightweight State-Space Model for Joint Progressive Sketch Classification and Stroke Auto-Completion26 Jul 2026
- 2026Stroke of Surprise: Progressive Semantic Illusions in Vector Sketching12 Feb 2026
- 2025Annotation-Free Human Sketch Quality Assessment28 Jul 2025
- 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection10 Jul 2025
- 2025StrokeFusion: Vector Sketch Generation via Joint Stroke-UDF Encoding and Latent Sequence Diffusion31 Mar 2025
- 2025ViSketch-GPT: Collaborative Multi-Scale Feature Extraction for Sketch Recognition and Generation28 Mar 2025
- 2025FedGAI: Federated Style Learning with Cloud-Edge Collaboration for Generative AI in Fashion Design16 Mar 2025
- 2025Sketch & Paint: Stroke-by-Stroke Evolution of Visual Artworks27 Feb 2025
- 2025Instance Segmentation of Scene Sketches Using Natural Image Priors13 Feb 2025
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation7 Jan 2025
- 2024SketchAgent: Language-Driven Sequential Sketch Generation26 Nov 2024
12 newest of 36 All 36 (JSON)