mlsanityData to 7 Oct 2026

Reconstruction of a 3D wireframe from a single line drawing via generative depth estimation

arXiv 2604.13549 ↗First posted 15 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reconstructing 3D geometry from 2D engineering line drawings is an inherently ambiguous problem: while visible strokes determine the object's projected structure, they do not specify the depth of each stroke. Rather than treating this problem as sketch-based asset generation, where models often infer unobserved structure, we study projection-faithful wireframe reconstruction: lifting a user-provided drawing into 3D according to its visible strokes. We formulate this task as conditional depth estimation over line drawings, predicting a depth value for each drawn pixel to produce a 3D wireframe. To model the ambiguities of orthographic projection, we implement a Latent Diffusion Model with spatial conditioning on the input sketch and optional partial-depth conditioning for iterative reconstruction. We train and evaluate our models on over three million synthetic image-depth pairs derived from CAD wireframes, including a newly curated corpus of roughly 90,000 shapes. Across varying shape complexities, our framework achieves robust reconstruction performance; scaling from 256 to 512 resolution with a retrained latent space roughly halves reconstruction error, reaching a 3.9% best-of-five (7.0% average) normalized depth error. These results demonstrate the potential of projection-faithful depth estimation as a user-controlled approach for iterative 3D wireframe creation in engineering design.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 67 references that are in the map. First posted on arXiv 15 Apr 2026.

Builds on

41 of 67 references.

References · 41

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  10. 2021Vision Transformers for Dense Predictioncited by 1,789
  11. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
29 more
  1. 2024Depth Anything V2cited by 1,385
  2. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  3. 2025DINOv3cited by 1,297
  4. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  5. 2019An Introduction to Variational Autoencoderscited by 997
  6. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  7. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  8. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
  9. 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 339
  10. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
  11. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
  12. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
  13. 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
  14. 2021Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketchescited by 50
  15. 2023SECAD-Net: Self-Supervised CAD Reconstruction by Learning Sketch-Extrude Operationscited by 46
  16. 2023Control3D: Towards Controllable Text-to-3D Generationcited by 46
  17. 20173D Sketching using Multi-View Deep Volumetric Predictioncited by 36
  18. 2024SketchDream: Sketch-based Text-to-3D Generation and Editingcited by 25
  19. 2022Neural Face Identification in a 2D Wireframe Projection of a Manifold Objectcited by 18
  20. 2022GeoCode: Interpretable Shape Programscited by 16
  21. 2022SketchSampler: Sketch-based 3D Reconstruction via View-dependent Depth Samplingcited by 14
  22. 2023Sketch-A-Shape: Zero-Shot Sketch-to-3D Shape Generationcited by 14
  23. 2024PICASSO: A Feed-Forward Framework for Parametric Inference of CAD Sketches via Rendering Self-Supervisioncited by 9
  24. 2022Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single Sketchcited by 6
  25. 2024Sketch2NeRF: Multi-view Sketch-guided Text-to-3D Generationcited by 6
  26. 2022Vitruvio: 3D Building Meshes via Single Perspective Sketchescited by 5
  27. 2024Sketch3D: Style-Consistent Guidance for Sketch-to-3D Generationcited by 4
  28. 2025SketchFusion: Learning Universal Sketch Features through Fusing Foundation Modelscited by 4
  29. 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025CLR-Wire: Towards Continuous Latent Representations for 3D Curve Wireframe Generation
  2. 2026S23DR 2026 Winning Solution
  3. 2025Shape from Semantics: 3D Shape Generation from Multi-View Semantics
  4. 2024Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior
  5. 2023Wired Perspectives: Multi-View Wire Art Embraces Generative AI
  6. 2026FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelity
  7. 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible
  8. 2022Cut-and-Approximate: 3D Shape Reconstruction from Planar Cross-sections with Deep Reinforcement Learning