mlsanityData to 14 Oct 2026

Hierarchical Neural Coding for Controllable CAD Model Generation

arXiv 2307.00149 ↗First posted 30 Jun 2023cs.CV cs.LGcited by 86

Not on the map. Why?

Abstract (arXiv)

This paper presents a novel generative model for Computer Aided Design (CAD) that 1) represents high-level design concepts of a CAD model as a three-level hierarchical tree of neural codes, from global part arrangement down to local curve geometry; and 2) controls the generation or completion of CAD models by specifying the target design using a code tree. Concretely, a novel variant of a vector quantized VAE with "masked skip connection" extracts design variations as neural codebooks at three levels. Two-stage cascaded auto-regressive transformers learn to generate code trees from incomplete CAD models and then complete CAD models following the intended design. Extensive experiments demonstrate superior performance on conventional tasks such as random generation while enabling novel interaction capabilities on conditional generation tasks. The code is available at https://github.com/samxuxiang/hnc-cad.

Key facts. Cited by 86 papers in the map (data through 14 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 30 Jun 2023.

Builds on

35 of 53 references.

References · 35

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  3. 2017Neural Discrete Representation Learningcited by 4,712
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  5. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  6. 2020Jukebox: A Generative Model for Musiccited by 542
  7. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
  8. 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 206
  9. 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 125
  10. 2017CSGNet: Neural Shape Parser for Constructive Solid Geometrycited by 106
  11. 2020ParSeNet: A Parametric Surface Fitting Network for 3D Point Cloudscited by 96
  12. 2019Write, Execute, Assess: Program Synthesis with a REPLcited by 93
23 more
  1. 2021Computer-Aided Design as Languagecited by 82
  2. 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 80
  3. 2020UCSG-Net -- Unsupervised Discovering of Constructive Solid Geometry Treecited by 78
  4. 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 75
  5. 2020SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Designcited by 72
  6. 2019Learning to Infer and Execute 3D Shape Programscited by 68
  7. 2021SketchGen: Generating Constrained CAD Sketchescited by 68
  8. 2020PIE-NET: Parametric Inference of Point Cloud Edgescited by 67
  9. 2021Vitruvion: A Generative Model of Parametric CAD Sketchescited by 66
  10. 2021CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assemblycited by 62
  11. 2021Point2Cyl: Reverse Engineering 3D Objects from Point Clouds to Extrusion Cylinderscited by 60
  12. 2021CSG-Stump: A Learning Friendly CSG-Like Representation for Interpretable Shape Parsingcited by 51
  13. 2021Inferring CAD Modeling Sequences Using Zone Graphscited by 50
  14. 2021Engineering Sketch Generation for Computer-Aided Designcited by 49
  15. 2023SECAD-Net: Self-Supervised CAD Reconstruction by Learning Sketch-Extrude Operationscited by 46
  16. 2016Squared Earth Mover's Distance-based Loss for Training Deep Neural Networkscited by 45
  17. 2022Reconstructing editable prismatic CAD from rounded voxel modelscited by 41
  18. 2022ExtrudeNet: Unsupervised Inverse Sketch-and-Extrude for Shape Parsingcited by 38
  19. 2020Fusion 360 Gallery: A Dataset and Environment for Programmatic CAD Construction from Human Design Sequencescited by 36
  20. 2023PLay: Parametrically Conditioned Layout Generation using Latent Diffusioncited by 24
  21. 2022Neural Face Identification in a 2D Wireframe Projection of a Manifold Objectcited by 18
  22. 2019Neural Shape Parsers for Constructive Solid Geometrycited by 14
  23. 2023Zero-shot CAD Program Re-Parameterization for Interactive Manipulationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 20; 2025: 28; 2026: 36.

86 papers.

Sort:

By area:

  1. 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 103
  2. 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 81
  3. 2025CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generationcited by 67
  4. 2024CAD-Recode: Reverse Engineering CAD Code from Point Cloudscited by 66
  5. 2024CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attentioncited by 64
  6. 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 53
  7. 2025Text-to-CAD Generation Through Infusing Visual Feedback in Large Language Modelscited by 47
  8. 2024CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solverscited by 40
  9. 2024Img2CAD: Conditioned 3D CAD Model Generation from Single Image with Structured Visual Geometrycited by 37
  10. 2024Img2CAD: Reverse Engineering 3D CAD Models from Images through VLM-Assisted Conditional Factorizationcited by 35
  11. 2025CADCrafter: Generating Computer-Aided Design Models from Unconstrained Imagescited by 35
  12. 2024FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Modelscited by 34
38 more
  1. 2025HoLa: B-Rep Generation using a Holistic Latent Representationcited by 30
  2. 2024TransCAD: A Hierarchical Transformer for CAD Sequence Inference from Point Cloudscited by 29
  3. 2024CadVLM: Bridging Language and Vision in the Generation of Parametric CAD Sketchescited by 28
  4. 2025Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeekcited by 24
  5. 2024Text2CAD: Generating Sequential CAD Models from Beginner-to-Expert Level Text Promptscited by 23
  6. 2025DTGBrepGen: A Novel B-rep Generative Model through Decoupling Topology and Geometrycited by 21
  7. 2023SHARP Challenge 2023: Solving CAD History and pArameters Recovery from Point clouds and 3D scans. Overview, Datasets, Metrics, and Baselinescited by 19
  8. 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editingcited by 19
  9. 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Cloudscited by 19
  10. 2025Large Language Models for Computer-Aided Design: A Surveycited by 18
  11. 2025AutoBrep: Autoregressive B-Rep Generation with Unified Topology and Geometrycited by 17
  12. 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learningcited by 16
  13. 2023CADTalk: An Algorithm and Benchmark for Semantic Commenting of CAD Programscited by 15
  14. 2024From 2D CAD Drawings to 3D Parametric Models: A Vision-Language Approachcited by 15
  15. 2025BrepGPT: Autoregressive B-rep Generation with Voronoi Half-Patchcited by 13
  16. 2026Text2CAD-Bench: A Benchmark for LLM-based Text-to-Parametric CAD Generationcited by 12
  17. 2025ReCAD: Reinforcement Learning Enhanced Parametric CAD Model Generation with Vision-Language Modelscited by 11
  18. 2025VLMaterial: Procedural Material Generation with Large Vision-Language Modelscited by 9
  19. 2025Aligning Constraint Generation with Design Intent in Parametric CADcited by 8
  20. 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Datacited by 8
  21. 2025RLCAD: Reinforcement Learning Training Gym for Revolution Involved CAD Command Sequence Generationcited by 7
  22. 2026Clarify Before You Draw: Proactive Agents for Robust Text-to-CAD Generationcited by 7
  23. 2026Towards High-Fidelity CAD Generation via LLM-Driven Program Generation and Text-Based B-Rep Primitive Groundingcited by 7
  24. 2024Don't Mesh with Me: Generating Constructive Solid Geometry Instead of Meshes by Fine-Tuning a Code-Generation LLMcited by 6
  25. 2025Revisiting CAD Model Generation by Learning Raster Sketchcited by 6
  26. 2025CMT: A Cascade MAR with Topology Predictor for Multimodal Conditional CAD Generationcited by 6
  27. 2026CADReasoner: Iterative Program Editing for CAD Reverse Engineeringcited by 6
  28. 2026TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learningcited by 6
  29. 2024ContrastCAD: Contrastive Learning-based Representation Learning for Computer-Aided Design Modelscited by 5
  30. 2024Luban: Building Open-Ended Creative Agents via Autonomous Embodied Verificationcited by 5
  31. 2025GeoCAD: Local Geometry-Controllable CAD Generation with Large Language Modelscited by 5
  32. 2025MiCADangelo: Fine-Grained Reconstruction of Constrained CAD Models from 3D Scanscited by 5
  33. 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Modelscited by 5
  34. 2025Point2Primitive: CAD Reconstruction from Point Cloud by Direct Primitive Predictioncited by 4
  35. 2026CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimizationcited by 4
  36. 2024Generative Design through Quality-Diversity Data Synthesis and Language Modelscited by 3
  37. 2024MV2Cyl: Reconstructing 3D Extrusion Cylinders from Multi-View Imagescited by 3
  38. 2026Mamba-CAD: State Space Model For 3D Computer-Aided Design Generative Modelingcited by 3

50 most cited of 86 All 86 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Generating CAD Code with Vision-Language Models for 3D Designs
  2. 2025CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generation
  3. 2024GenCAD: Image-Conditioned Computer-Aided Design Generation with Transformer-Based Contrastive Representation and Diffusion Priors
  4. 2026Draw it like Euclid: Teaching transformer models to generate CAD profiles using ruler and compass construction steps
  5. 2025EvoCAD: Evolutionary CAD Code Generation with Vision Language Models
  6. 2025GenCAD-3D: CAD Program Generation using Multimodal Latent Space Alignment and Synthetic Dataset Balancing
  7. 2025CME-CAD: Heterogeneous Collaborative Multi-Expert Reinforcement Learning for CAD Code Generation
  8. 2025A Solver-Aided Hierarchical Language for LLM-Driven CAD Design