mlsanityData to 7 Oct 2026

Deep Sketch-Based 3D Modeling: A Survey

arXiv 2603.03287 ↗First posted 22 Jan 2026cs.GR cs.CV cs.HCcited by 3

Not on the map. Why?

Abstract (arXiv)

In the past decade, advances in artificial intelligence have revolutionized sketch-based 3D modeling, leading to a new paradigm known as Deep Sketch-Based 3D Modeling (DS-3DM). DS-3DM offers data-driven methods that address the long-standing challenges of sketch abstraction and ambiguity. DS-3DM keeps humans at the center of the creative process by enhancing the flexibility, usability, faithfulness, and adaptability of sketch-based 3D modeling interfaces. This paper contributes a comprehensive survey of the latest DS-3DM within a novel design space: MORPHEUS. Built upon the Input-Model-Output (IMO) framework, MORPHEUS categorizes Models outputting Options of 3D Representations and Parts, derived from Human inputs (varying in quantity and modality), and Evaluated across diverse User-views and Styles. Throughout MORPHEUS we highlight limitations and identify opportunities for interdisciplinary research in Computer Vision, Computer Graphics, and Human-Computer Interaction, revealing a need for controllability and information-rich outputs. These opportunities align design processes more closely with user' intent, responding to the growing importance of user-centered approaches.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 153 of its 286 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

153 of 286 references.

References · 153

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  9. 2022Classifier-Free Diffusion Guidancecited by 5,717
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  12. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
38 more
  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  2. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  3. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  4. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  5. 2021Variational Diffusion Modelscited by 1,145
  6. 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,010
  7. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  8. 2024Simple and Effective Masked Diffusion Language Modelscited by 800
  9. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  10. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
  11. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  12. 2015Holistically-Nested Edge Detectioncited by 590
  13. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  14. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  15. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
  16. 2021A Survey of Transformerscited by 399
  17. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 376
  18. 2022Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioningcited by 362
  19. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  20. 2017A Neural Representation of Sketch Drawingscited by 311
  21. 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
  22. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  23. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  24. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
  25. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
  26. 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
  27. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
  28. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 141
  29. 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
  30. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  31. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
  32. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  33. 2019Superquadrics Revisited: Learning 3D Shape Parsing beyond Cuboidscited by 123
  34. 2020Differentiable Rendering: A Surveycited by 123
  35. 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 121
  36. 2020MeshSDF: Differentiable Iso-Surface Extractioncited by 112
  37. 2017MarrNet: 3D Shape Reconstruction via 2.5D Sketchescited by 108
  38. 2017CSGNet: Neural Shape Parser for Constructive Solid Geometrycited by 106

50 most cited of 153 All 153 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

  1. 2026Reconstruction of a 3D wireframe from a single line drawing via generative depth estimationcited by 0
  2. 2026Sketch2Arti: Sketch-based Articulation Modeling of CAD Objectscited by 0
  3. 2026Creativity from Friction: Human-AI Interaction for Exploratory Structural Designcited by 0