mlsanityData to 14 Oct 2026

RealCAD: Towards Real-World Image-to-CAD Reconstruction under Domain Shift and Parameter Bias

arXiv 2608.30617 ↗First posted 31 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reconstructing editable Computer-Aided Design (CAD) models from images is essential for downstream modification, manufacturing, and design reuse. However, existing image-to-CAD methods are developed predominantly on synthetic renderings and face two coupled obstacles: a substantial appearance domain gap between synthetic and real images, and a previously overlooked parameter bias in widely used CAD data. We show that the local normalization adopted by DeepCAD concentrates several geometric parameters around a few discrete values while encoding substantial information in a single scale factor. Consequently, a model can achieve deceptively high parameter accuracy by exploiting these frequent values rather than inferring geometry from the input image. In this paper, we propose RealCAD, a unified framework that addresses these limitations at the representation, image, and feature levels. At the representation level, we redistribute scale information to the corresponding geometric parameters, producing less concentrated parameter distributions in a shared scale space. At the image level, geometry-constrained translation converts synthetic renderings toward the real-image domain while conditioning on object contours. At the feature level, a multi-positive contrastive objective aligns representations of the same CAD model across viewpoints and image domains, enabling CAD sequence prediction from each individual view. We further introduce OpenRealCAD, comprising four-view photographs of 392 3D-printed objects paired with ground-truth command sequences. Experiments show that the revised representation substantially reduces the accuracy attainable from parameter-frequency priors, making parameter accuracy a more reliable measure of image-conditioned geometric inference. RealCAD further improves real-domain command and parameter accuracy, while retaining competitive synthetic-domain performance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 41 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

27 of 41 references.

References · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020End-to-End Object Detection with Transformerscited by 7,414
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  5. 2017Improved Training of Wasserstein GANscited by 2,235
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  7. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  8. 2018Image Transformercited by 772
  9. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  10. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  11. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
  12. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
15 more
  1. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  2. 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
  3. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
  4. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 269
  5. 2020Learning Gradient Fields for Shape Generationcited by 245
  6. 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 206
  7. 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
  8. 2017CSGNet: Neural Shape Parser for Constructive Solid Geometrycited by 106
  9. 2020ParSeNet: A Parametric Surface Fitting Network for 3D Point Cloudscited by 96
  10. 2021Inferring CAD Modeling Sequences Using Zone Graphscited by 50
  11. 2023SECAD-Net: Self-Supervised CAD Reconstruction by Learning Sketch-Extrude Operationscited by 46
  12. 2025CADCrafter: Generating Computer-Aided Design Models from Unconstrained Imagescited by 35
  13. 2023TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervisioncited by 28
  14. 2026AnchorSplat: Feed-Forward 3D Gaussian Splatting with 3D Geometric Priorscited by 8
  15. 2026Img2CADSeq: Image-to-CAD Generation via Sequence-Based Diffusioncited by 2

Built on by

Not cited yet.