mlsanityData to 7 Oct 2026

3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks

arXiv 1707.06375 ↗First posted 20 Jul 2017cs.CV cs.GRcited by 44

Not on the map. Why?

Abstract (arXiv)

We propose a method for reconstructing 3D shapes from 2D sketches in the form of line drawings. Our method takes as input a single sketch, or multiple sketches, and outputs a dense point cloud representing a 3D reconstruction of the input sketch(es). The point cloud is then converted into a polygon mesh. At the heart of our method lies a deep, encoder-decoder network. The encoder converts the sketch into a compact representation encoding shape information. The decoder converts this representation into depth and normal maps capturing the underlying surface from several output viewpoints. The multi-view maps are then consolidated into a 3D point cloud by solving an optimization problem that fuses depth and normals across all viewpoints. Based on our experiments, compared to other methods, such as volumetric networks, our architecture offers several advantages, including more faithful reconstruction, higher output surface resolution, better preservation of topology and shape structure.

Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jul 2017.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 10; 2022: 8; 2023: 15; 2024: 8; 2025: 3.

44 papers.

Sort:

By area:

  1. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
  2. 2023SKED: Sketch-guided Text-based 3D Editingcited by 72
  3. 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
  4. 2021Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketchescited by 50
  5. 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
  6. 2024Make-A-Shape: a Ten-Million-scale 3D Shape Modelcited by 25
  7. 2021Adversarial Open Domain Adaptation for Sketch-to-Photo Synthesiscited by 24
  8. 20233D-aware Conditional Image Synthesiscited by 24
  9. 2021Augmenting Implicit Neural Shape Representations with Explicit Deformation Fieldscited by 19
  10. 2021SketchLattice: Latticed Representation for Sketch Manipulationcited by 19
  11. 2023PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characterscited by 16
  12. 2022SketchSampler: Sketch-based 3D Reconstruction via View-dependent Depth Samplingcited by 14
32 more
  1. 2023Sketch-A-Shape: Zero-Shot Sketch-to-3D Shape Generationcited by 14
  2. 2023T2TD: Text-3D Generation Model based on Prior Knowledge Guidancecited by 13
  3. 20233D VR Sketch Guided 3D Shape Prototyping and Explorationcited by 12
  4. 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodingscited by 10
  5. 2021SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head Designcited by 9
  6. 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectivescited by 9
  7. 2024External Knowledge Enhanced 3D Scene Generation from Sketchcited by 9
  8. 2023SENS: Part-Aware Sketch-based Implicit Neural Shape Modelingcited by 8
  9. 2022Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single Sketchcited by 6
  10. 2023Sketch2Cloth: Sketch-based 3D Garment Generation with Unsigned Distance Fieldscited by 5
  11. 2023SketchMetaFace: A Learning-based Sketching Interface for High-fidelity 3D Character Face Modelingcited by 4
  12. 2024Sketch3D: Style-Consistent Guidance for Sketch-to-3D Generationcited by 4
  13. 2024GroundUp: Rapid Sketch-Based 3D City Massingcited by 4
  14. 2021Sketch-based Normal Map Generation with Geometric Samplingcited by 3
  15. 2022Interactive Sketching of Mannequin Posescited by 3
  16. 2023Query-guided Attention in Vision Transformers for Localizing Objects Using a Single Sketchcited by 3
  17. 2023Fine-Tuned but Zero-Shot 3D Shape Sketch View Similarity and Retrievalcited by 3
  18. 2022DifferSketching: How Differently Do People Sketch 3D Objects?cited by 2
  19. 2023Sketch Beautification: Learning Part Beautification and Structure Refinement for Sketches of Man-made Objectscited by 2
  20. 2025PASTA: Part-Aware Sketch-to-3D Shape Generation with Text-Aligned Priorcited by 2
  21. 2021Early-Phase Performance-Driven Design using Generative Modelscited by 1
  22. 2022SingleSketch2Mesh : Generating 3D Mesh model from Sketchcited by 1
  23. 2023Sketch2Stress: Sketching with Structural Stress Awarenesscited by 1
  24. 2024A Concept for Reconstructing Stucco Statues from historic Sketches using synthetic Data onlycited by 1
  25. 2025From Air to Wear: Personalized 3D Digital Fashion with AR/VR Immersive 3D Sketchingcited by 1
  26. 20213D-MOV: Audio-Visual LSTM Autoencoder for 3D Reconstruction of Multiple Objects from Videocited by 0
  27. 2022Interactive 3D Character Modeling from 2D Orthogonal Drawings with Annotationscited by 0
  28. 2022Reconstructing vehicles from orthographic drawings using deep neural networkscited by 0
  29. 2023Sketch-based Video Object Localizationcited by 0
  30. 2024One-to-many Reconstruction of 3D Geometry of cultural Artifacts using a synthetically trained Generative Modelcited by 0
  31. 2024Revisiting Marr in Face: The Building of 2D--2.5D--3D Representations in Deep Neural Networkscited by 0
  32. 2025Order Matters: 3D Shape Generation from Sequential VR Sketchescited by 0