mlsanityData to 7 Oct 2026

Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapes

arXiv 2312.04043 ↗First posted 7 Dec 2023cs.CV cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

In this paper, we democratise 3D content creation, enabling precise generation of 3D shapes from abstract sketches while overcoming limitations tied to drawing skills. We introduce a novel part-level modelling and alignment framework that facilitates abstraction modelling and cross-modal correspondence. Leveraging the same part-level decoder, our approach seamlessly extends to sketch modelling by establishing correspondence between CLIPasso edgemaps and projected 3D part regions, eliminating the need for a dataset pairing human sketches and 3D shapes. Additionally, our method introduces a seamless in-position editing process as a byproduct of cross-modal part-aligned modelling. Operating in a low-dimensional implicit space, our approach significantly reduces computational demands and processing time.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 69 of its 93 references that are in the map. First posted on arXiv 7 Dec 2023.

Builds on

69 of 93 references.

References · 69

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  8. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  9. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  10. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  12. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
38 more
  1. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  2. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  3. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  4. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  5. 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 487
  6. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  7. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
  8. 2017A Neural Representation of Sketch Drawingscited by 311
  9. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
  10. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  11. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  12. 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 205
  13. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
  14. 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
  15. 2021SMPLicit: Topology-aware Generative Model for Clothed Peoplecited by 154
  16. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
  17. 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functionscited by 133
  18. 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
  19. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
  20. 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
  21. 2019Superquadrics Revisited: Learning 3D Shape Parsing beyond Cuboidscited by 123
  22. 2020Image GANs meet Differentiable Rendering for Inverse Graphics and Interpretable 3D Neural Renderingcited by 101
  23. 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
  24. 2022Learning to generate line drawings that convey geometry and semanticscited by 82
  25. 2023CLIP for All Things Zero-Shot Sketch-Based Image Retrieval, Fine-Grained or Notcited by 79
  26. 2020Learning Unsupervised Hierarchical Part Decomposition of 3D Objects from a Single RGB Imagecited by 72
  27. 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
  28. 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
  29. 2021CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assemblycited by 62
  30. 2020Deep Learning for Free-Hand Sketch: A Surveycited by 59
  31. 2020Sketch Less for More: On-the-Fly Fine-Grained Sketch Based Image Retrievalcited by 59
  32. 2022CLIPasso: Semantically-Aware Object Sketchingcited by 57
  33. 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
  34. 2018Learning a Shared Shape Space for Multimodal Garment Designcited by 52
  35. 2021Multi-view 3D Reconstruction with Transformercited by 52
  36. 2017Deformable Shape Completion with Graph Convolutional Autoencoderscited by 50
  37. 2021Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketchescited by 50
  38. 2022Dynamic 3D Scene Analysis by Point Cloud Accumulationcited by 47

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 7; 2026: 3.

14 papers.

Sort:

By area:

  1. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  2. 20243Doodle: Compact Abstraction of Objects with 3D Strokescited by 21
  3. 2024SketchINR: A First Look into Sketches as Implicit Neural Representationscited by 13
  4. 2024FlipSketch: Flipping Static Drawings to Text-Guided Sketch Animationscited by 8
  5. 2025MeshPad: Interactive Sketch-Conditioned Artist-Reminiscent Mesh Generation and Editingcited by 6
  6. 2024What Sketch Explainability Really Means for Downstream Taskscited by 4
  7. 2025SketchFusion: Learning Universal Sketch Features through Fusing Foundation Modelscited by 4
  8. 2025VRsketch2Gaussian: 3D VR Sketch Guided 3D Object Generation with Gaussian Splattingcited by 3
  9. 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
  10. 2025PASTA: Part-Aware Sketch-to-3D Shape Generation with Text-Aligned Priorcited by 2
  11. 2025From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketchingcited by 1
  12. 2025Order Matters: 3D Shape Generation from Sequential VR Sketchescited by 0
2 more
  1. 2026Diff-SBSR: Learning Multimodal Feature-Enhanced Diffusion Models for Zero-Shot Sketch-Based 3D Shape Retrievalcited by 0
  2. 20263DMorph: Single-Image-Guided Local 3D Shape Editing and Morphingcited by 0