mlsanityData to 14 Oct 2026

DemoCaricature: Democratising Caricature Generation with a Rough Sketch

arXiv 2312.04364 ↗First posted 7 Dec 2023cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

In this paper, we democratise caricature generation, empowering individuals to effortlessly craft personalised caricatures with just a photo and a conceptual sketch. Our objective is to strike a delicate balance between abstraction and identity, while preserving the creativity and subjectivity inherent in a sketch. To achieve this, we present Explicit Rank-1 Model Editing alongside single-image personalisation, selectively applying nuanced edits to cross-attention layers for a seamless merge of identity and style. Additionally, we propose Random Mask Reconstruction to enhance robustness, directing the model to focus on distinctive identity and style features. Crucially, our aim is not to replace artists but to eliminate accessibility barriers, allowing enthusiasts to engage in the artistry.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 53 of its 69 references that are in the map. First posted on arXiv 7 Dec 2023.

Builds on

53 of 69 references.

References · 53

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  11. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  12. 2022Classifier-Free Diffusion Guidancecited by 5,847
38 more
  1. 2022Generative Adversarial Networkscited by 5,627
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  3. 2017Squeeze-and-Excitation Networkscited by 4,789
  4. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  6. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  7. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  8. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  9. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  10. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  12. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  13. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  14. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  15. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  16. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  17. 2023Emergent Correspondence from Image Diffusioncited by 446
  18. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
  19. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
  20. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  21. 2023Your Diffusion Model is Secretly a Zero-Shot Classifiercited by 306
  22. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  23. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 199
  24. 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
  25. 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
  26. 2021Repurposing GANs for One-shot Semantic Part Segmentationcited by 88
  27. 2021HairCLIP: Design Your Hair by Text and Reference Imagecited by 80
  28. 2023Sensitivity-Aware Visual Parameter-Efficient Fine-Tuningcited by 74
  29. 2020Few-Shot Adaptation of Generative Adversarial Networkscited by 64
  30. 2023Prompt-Free Diffusion: Taking "Text" out of Text-to-Image Diffusion Modelscited by 62
  31. 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketchescited by 34
  32. 2018WarpGAN: Automatic Caricature Generationcited by 28
  33. 2020Why Do Line Drawings Work? A Realism Hypothesiscited by 28
  34. 2022DreamArtist++: Controllable One-Shot Text-to-Image Generation via Positive-Negative Adaptercited by 24
  35. 2022Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketchescited by 23
  36. 2023What Can Human Sketches Do for Object Detection?cited by 19
  37. 2021Inverting Generative Adversarial Renderer for Face Reconstructioncited by 17
  38. 2020AutoToon: Automatic Geometric Warping for Face Cartoon Generationcited by 12

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 6; 2025: 2; 2026: 2.

10 papers.

  1. 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 83
  2. 2024It's All About Your Sketch: Democratising Sketch Control in Diffusion Modelscited by 29
  3. 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
  4. 2025DynamicID: Zero-Shot Multi-ID Image Personalization with Flexible Facial Editabilitycited by 10
  5. 2024Text-to-Image Diffusion Models are Great Sketch-Photo Matchmakerscited by 8
  6. 2024S2TD-Face: Reconstruct a Detailed 3D Face with Controllable Texture from a Single Sketchcited by 5
  7. 2024PortraitTalk: Towards Customizable One-Shot Audio-to-Talking Face Generationcited by 5
  8. 2025SketchFusion: Learning Universal Sketch Features through Fusing Foundation Modelscited by 4
  9. 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
  10. 2026CaricHarmony: Contrastive Diffusion Paths for Identity-Preserving Caricature Synthesiscited by 0