mlsanityData to 14 Oct 2026

Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketches

arXiv 2105.06663 ↗First posted 14 May 2021cs.CVcited by 54

Not on the map. Why?

Abstract (arXiv)

We investigate the problem of generating 3D meshes from single free-hand sketches, aiming at fast 3D modeling for novice users. It can be regarded as a single-view reconstruction problem, but with unique challenges, brought by the variation and conciseness of sketches. Ambiguities in poorly-drawn sketches could make it hard to determine how the sketched object is posed. In this paper, we address the importance of viewpoint specification for overcoming such ambiguities, and propose a novel view-aware generation approach. By explicitly conditioning the generation process on a given viewpoint, our method can generate plausible shapes automatically with predicted viewpoints, or with specified viewpoints to help users better express their intentions. Extensive evaluations on various datasets demonstrate the effectiveness of our view-aware design in solving sketch ambiguities and improving reconstruction quality.

Key facts. Cited by 54 papers in the map (data through 14 Oct 2026). Builds on 22 of its 42 references that are in the map. First posted on arXiv 14 May 2021.

Builds on

22 of 42 references.

References · 22

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  3. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  4. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  5. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  6. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
  7. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
  8. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
  9. 2017Neural 3D Mesh Renderercited by 437
  10. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  11. 2017Learning a Multi-View Stereo Machinecited by 194
  12. 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
10 more
  1. 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
  2. 2020Self-supervised Single-view 3D Reconstruction via Semantic Consistencycited by 127
  3. 2016Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervisioncited by 106
  4. 20173D Shape Reconstruction from Sketches via Multi-view Convolutional Networkscited by 45
  5. 2015Sketch-based 3D Shape Retrieval using Convolutional Neural Networkscited by 41
  6. 20173D Sketching using Multi-View Deep Volumetric Predictioncited by 37
  7. 2017Image2Mesh: A Learning Framework for Single Image 3D Reconstructioncited by 29
  8. 2019DeepSketchHair: Deep Sketch-based 3D Hair Modelingcited by 25
  9. 20203D Shape Reconstruction from Free-Hand Sketchescited by 20
  10. 2017DeepSketch2Face: A Deep Learning Based Sketching System for 3D Face and Caricature Modelingcited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 7; 2023: 21; 2024: 13; 2025: 9; 2026: 4.

54 papers.

Sort:

By area:

  1. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  2. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 288
  3. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  4. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
  5. 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 110
  6. 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
  7. 2023Sketch and Text Guided Diffusion Model for Colored Point Cloud Generationcited by 36
  8. 2022Cross-Modal 3D Shape Generation and Manipulationcited by 28
  9. 2022Doodle It Yourself: Class Incremental Learning by Drawing a Few Sketchescited by 23
  10. 20243Doodle: Compact Abstraction of Objects with 3D Strokescited by 21
  11. 2024AToM: Amortized Text-to-Mesh using 2D Diffusioncited by 18
  12. 2023Sketch2Saliency: Learning to Detect Salient Objects from Human Drawingscited by 17
38 more
  1. 2022SketchSampler: Sketch-based 3D Reconstruction via View-dependent Depth Samplingcited by 14
  2. 2023Sketch-A-Shape: Zero-Shot Sketch-to-3D Shape Generationcited by 14
  3. 2023SEVA: Leveraging sketches to evaluate alignment between human and machine visual abstractioncited by 14
  4. 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapescited by 14
  5. 2023T2TD: Text-3D Generation Model based on Prior Knowledge Guidancecited by 13
  6. 20233D VR Sketch Guided 3D Shape Prototyping and Explorationcited by 12
  7. 2023Pushing the Limits of 3D Shape Generation at Scalecited by 11
  8. 2023CLIPXPlore: Coupled CLIP and Shape Spaces for 3D Shape Explorationcited by 9
  9. 2024External Knowledge Enhanced 3D Scene Generation from Sketchcited by 9
  10. 2024CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimizationcited by 8
  11. 2022Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single Sketchcited by 6
  12. 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assetscited by 6
  13. 2023Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fieldscited by 5
  14. 2023Deep3DSketch+: Rapid 3D Modeling from Single Free-hand Sketchescited by 5
  15. 2024Magic3DSketch: Create Colorful 3D Models From Sketch-Based 3D Modeling Guided by Text and Language-Image Pre-Trainingcited by 5
  16. 2023SketchMetaFace: A Learning-based Sketching Interface for High-fidelity 3D Character Face Modelingcited by 4
  17. 2024What Sketch Explainability Really Means for Downstream Taskscited by 4
  18. 2024Learning Coherent Matrixized Representation in Latent Space for Volumetric 4D Generationcited by 4
  19. 2024Flow Score Distillation for Diverse Text-to-3D Generationcited by 4
  20. 2024GroundUp: Rapid Sketch-Based 3D City Massingcited by 4
  21. 2024Pixel-Aligned Multi-View Generation with Depth Guided Decodercited by 4
  22. 2025Touch2Shape: Touch-Conditioned 3D Diffusion for Shape Exploration and Reconstructioncited by 4
  23. 2023Fine-Tuned but Zero-Shot 3D Shape Sketch View Similarity and Retrievalcited by 3
  24. 2025VRsketch2Gaussian: 3D VR Sketch Guided 3D Object Generation with Gaussian Splattingcited by 3
  25. 2025PASTA: Part-Aware Sketch-to-3D Shape Generation with Text-Aligned Priorcited by 3
  26. 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
  27. 2022DifferSketching: How Differently Do People Sketch 3D Objects?cited by 2
  28. 2024Do Generalised Classifiers really work on Human Drawn Sketches?cited by 2
  29. 2022Deep Learning Assisted Optimization for 3D Reconstruction from Single 2D Line Drawingscited by 1
  30. 2023Sketch2Stress: Sketching with Structural Stress Awarenesscited by 1
  31. 2025From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketchingcited by 1
  32. 20233Deformer: A Common Framework for Image-Guided Mesh Deformationcited by 0
  33. 2023Sketch2CAD: 3D CAD Model Reconstruction from 2D Sketch using Visual Transformercited by 0
  34. 2023SketchBodyNet: A Sketch-Driven Multi-faceted Decoder Network for 3D Human Reconstructioncited by 0
  35. 2024C3DAG: Controlled 3D Animal Generation using 3D pose guidancecited by 0
  36. 2025DiffS-NOCS: 3D Point Cloud Reconstruction through Coloring Sketches to NOCS Maps Using Diffusion Modelscited by 0
  37. 2025Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detectioncited by 0
  38. 2025Interactive Drawing Guidance for Anime Illustrations with Diffusion Modelcited by 0

50 most cited of 54 All 54 (JSON)