Reconstruction of a 3D wireframe from a single line drawing via generative depth estimation
Not on the map. Why?
Abstract (arXiv)
Reconstructing 3D geometry from 2D engineering line drawings is an inherently ambiguous problem: while visible strokes determine the object's projected structure, they do not specify the depth of each stroke. Rather than treating this problem as sketch-based asset generation, where models often infer unobserved structure, we study projection-faithful wireframe reconstruction: lifting a user-provided drawing into 3D according to its visible strokes. We formulate this task as conditional depth estimation over line drawings, predicting a depth value for each drawn pixel to produce a 3D wireframe. To model the ambiguities of orthographic projection, we implement a Latent Diffusion Model with spatial conditioning on the input sketch and optional partial-depth conditioning for iterative reconstruction. We train and evaluate our models on over three million synthetic image-depth pairs derived from CAD wireframes, including a newly curated corpus of roughly 90,000 shapes. Across varying shape complexities, our framework achieves robust reconstruction performance; scaling from 256 to 512 resolution with a retrained latent space roughly halves reconstruction error, reaching a 3.9% best-of-five (7.0% average) normalized depth error. These results demonstrate the potential of projection-faithful depth estimation as a user-controlled approach for iterative 3D wireframe creation in engineering design.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 67 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
41 of 67 references.
References · 41
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
29 more
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2025DINOv3cited by 1,297
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2019An Introduction to Variational Autoencoderscited by 997
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
- 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 339
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
- 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
- 2021Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketchescited by 50
- 2023SECAD-Net: Self-Supervised CAD Reconstruction by Learning Sketch-Extrude Operationscited by 46
- 2023Control3D: Towards Controllable Text-to-3D Generationcited by 46
- 20173D Sketching using Multi-View Deep Volumetric Predictioncited by 36
- 2024SketchDream: Sketch-based Text-to-3D Generation and Editingcited by 25
- 2022Neural Face Identification in a 2D Wireframe Projection of a Manifold Objectcited by 18
- 2022GeoCode: Interpretable Shape Programscited by 16
- 2022SketchSampler: Sketch-based 3D Reconstruction via View-dependent Depth Samplingcited by 14
- 2023Sketch-A-Shape: Zero-Shot Sketch-to-3D Shape Generationcited by 14
- 2024PICASSO: A Feed-Forward Framework for Parametric Inference of CAD Sketches via Rendering Self-Supervisioncited by 9
- 2022Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single Sketchcited by 6
- 2024Sketch2NeRF: Multi-view Sketch-guided Text-to-3D Generationcited by 6
- 2022Vitruvio: 3D Building Meshes via Single Perspective Sketchescited by 5
- 2024Sketch3D: Style-Consistent Guidance for Sketch-to-3D Generationcited by 4
- 2025SketchFusion: Learning Universal Sketch Features through Fusing Foundation Modelscited by 4
- 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CLR-Wire: Towards Continuous Latent Representations for 3D Curve Wireframe Generation
- 2026S23DR 2026 Winning Solution
- 2025Shape from Semantics: 3D Shape Generation from Multi-View Semantics
- 2024Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior
- 2023Wired Perspectives: Multi-View Wire Art Embraces Generative AI
- 2026FlowObject: Flow Steering for Bridging Generative Priors and Reconstruction Fidelity
- 2026World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible
- 2022Cut-and-Approximate: 3D Shape Reconstruction from Planar Cross-sections with Deep Reinforcement Learning