CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generation
Not on the map. Why?
Abstract (arXiv)
Efficient creation of accurate and editable 3D CAD models is critical in engineering design, significantly impacting cost and time-to-market in product innovation. Current manual workflows remain highly time-consuming and demand extensive user expertise. While recent developments in AI-driven CAD generation show promise, existing models are limited by incomplete representations of CAD operations, inability to generalize to real-world images, and low output accuracy. This paper introduces CAD-Coder, an open-source Vision-Language Model (VLM) explicitly fine-tuned to generate editable CAD code (CadQuery Python) directly from visual input. Leveraging a novel dataset that we created--GenCAD-Code, consisting of over 163k CAD-model image and code pairs--CAD-Coder outperforms state-of-the-art VLM baselines such as GPT-4.5 and Qwen2.5-VL-72B, achieving a 100% valid syntax rate and the highest accuracy in 3D solid similarity. Notably, our VLM demonstrates some signs of generalizability, successfully generating CAD code from real-world images and executing CAD operations unseen during fine-tuning. The performance and adaptability of CAD-Coder highlights the potential of VLMs fine-tuned on code to streamline CAD workflows for engineers and designers. CAD-Coder is publicly available at: https://github.com/anniedoris/CAD-Coder.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Builds on 29 of its 34 references that are in the map. First posted on arXiv 20 May 2025.
Builds on
29 of 34 references.
References · 29
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Visual Instruction Tuningcited by 7,869
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
17 more
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
- 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 125
- 2017CSGNet: Neural Shape Parser for Constructive Solid Geometrycited by 106
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 103
- 2023Fine-tuning can cripple your foundation model; preserving features may be the solutioncited by 96
- 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 80
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 62
- 2021Engineering Sketch Generation for Computer-Aided Designcited by 49
- 2024CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solverscited by 40
- 2024GenCAD: Image-Conditioned Computer-Aided Design Generation with Transformer-Based Contrastive Representation and Diffusion Priorscited by 38
- 2025Activation-Informed Merging of Large Language Modelscited by 30
- 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvementcited by 29
- 2024CadVLM: Bridging Language and Vision in the Generation of Parametric CAD Sketchescited by 28
- 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Designcited by 26
- 2025From Idea to CAD: A Language Model-Driven Multi-Agent System for Collaborative Designcited by 14
- 2021Deep Learning for Technical Document Classificationcited by 11
Built on by
Citing papers per year: 2025: 8; 2026: 35.
43 papers.
Sort:
By area:
- 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learningcited by 16
- 2025From Intent to Execution: Multimodal Chain-of-Thought Reinforcement Learning for Precise CAD Code Generationcited by 12
- 2025ReCAD: Reinforcement Learning Enhanced Parametric CAD Model Generation with Vision-Language Modelscited by 11
- 2026CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generationcited by 11
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 9
- 2025GenCAD-3D: CAD Program Generation using Multimodal Latent Space Alignment and Synthetic Dataset Balancingcited by 8
- 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Datacited by 8
- 2025EvoCAD: Evolutionary CAD Code Generation with Vision Language Modelscited by 6
- 2026CADReasoner: Iterative Program Editing for CAD Reverse Engineeringcited by 6
- 2026TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learningcited by 6
- 2026SceneActBench: Can Agents Act on the 3D Scenes They See?cited by 6
- 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Modelscited by 5
31 more
- 2026CADEngBench: It Looks Like CAD, but Does It Work? Evaluating Parametric Design, Assembly Reasoning, and Physics Simulationcited by 5
- 2026CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimizationcited by 4
- 2026Embodied CAD: Solver-Grounded LLM Agents for Parametric B-Rep Assembly Modelingcited by 4
- 2025A Survey of AI Methods for Geometry Preparation and Mesh Generation in Engineering Simulationcited by 3
- 2026GIFT: Bootstrapping Image-to-CAD Program Synthesis via Geometric Feedbackcited by 3
- 2026Physics-in-the-Loop: A Hybrid Agentic Architecture for Validated CAD Engineering Designcited by 3
- 2026SldprtNet: A Large-Scale Multimodal Dataset for CAD Generation in Language-Driven 3D Designcited by 2
- 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedbackcited by 2
- 2026Nova3D: Code-Native Generation of Programmable 3D Assetscited by 2
- 2025SciTextures: Collecting and Connecting Visual Patterns, Models, and Code Across Science and Artcited by 1
- 2025BrepLLM: Enabling Large Language Models to Understand Boundary Representationscited by 1
- 2026STEP-LLM: Generating CAD STEP Models from Natural Language with Large Language Modelscited by 1
- 2026CADENA: Stepwise CAD Reverse Engineeringcited by 1
- 2026OmniCAD: A Large-Scale Benchmark for 3D Spatial Reasoning in Robotics Assembliescited by 1
- 2026CADForge: Agentic Single-View CAD Reconstruction with Explicit Geometry Reasoningcited by 1
- 2026Coding the Visual World: From Image to Simulation Using Vision Language Modelscited by 0
- 2026Learning From Design Procedure To Generate CAD Programs for Data Augmentationcited by 0
- 2026Design-Specification Tiling for ICL-based CAD Code Generationcited by 0
- 2026Bioinspired123D: Generative 3D Modeling System for Bioinspired Structurescited by 0
- 2026Agentic AI in Engineering and Manufacturing: Industry Perspectives on Utility, Adoption, Challenges, and Opportunitiescited by 0
- 2026Enhancing Creativity in 3D Generative Design via a TRIZ-Inspired Text-to-CAD Frameworkcited by 0
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstructioncited by 0
- 2026RA-CAD: Learning Post-Execution Critique for State-Aware Text-to-CAD Generationcited by 0
- 2026Test-Time Scaling for CAD Generation via Verifier-Free Consensus Selectioncited by 0
- 2026CIT-CAD: Constraint Intent Tree-based CAD Code Generation and Verificationcited by 0
- 2026Vision2CAD: A Visual Agent Harness for Explicit Geometry Referencing and Localization in Parametric CAD Modelingcited by 0
- 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editingcited by 0
- 2026ConCAD: Constraint-Aware Image-to-CAD Generation with Dual-Granularity Rewardscited by 0
- 2026StepCAD: Mesh-to-CAD Code Generation via LLM Policy and Geometry-Guided Searchcited by 0
- 2026CADFather: Autonomous CAD Reconstruction through Coordinated Tool Usecited by 0
- 2026Rethinking Human Intent-to-CAD: Parametric CAD Model Generation via Cooperative Multi-Task Alignment and Spatial-Aware Reinforcement Learningcited by 0
- 2026Rethinking Human Intent-to-CAD: Parametric CAD Model Generation via Cooperative Multi-Task Alignment and Spatial-Aware Reinforcement Learning11 Oct 2026
- 2026CADFather: Autonomous CAD Reconstruction through Coordinated Tool Use6 Oct 2026
- 2026CADForge: Agentic Single-View CAD Reconstruction with Explicit Geometry Reasoning3 Oct 2026
- 2026StepCAD: Mesh-to-CAD Code Generation via LLM Policy and Geometry-Guided Search1 Oct 2026
- 2026ConCAD: Constraint-Aware Image-to-CAD Generation with Dual-Granularity Rewards28 Sep 2026
- 2026Vision2CAD: A Visual Agent Harness for Explicit Geometry Referencing and Localization in Parametric CAD Modeling19 Sep 2026
- 2026CIT-CAD: Constraint Intent Tree-based CAD Code Generation and Verification7 Sep 2026
- 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editing28 Aug 2026
- 2026OmniCAD: A Large-Scale Benchmark for 3D Spatial Reasoning in Robotics Assemblies23 Aug 2026
- 2026Test-Time Scaling for CAD Generation via Verifier-Free Consensus Selection10 Aug 2026
- 2026CADEngBench: It Looks Like CAD, but Does It Work? Evaluating Parametric Design, Assembly Reasoning, and Physics Simulation10 Aug 2026
- 2026RA-CAD: Learning Post-Execution Critique for State-Aware Text-to-CAD Generation6 Aug 2026
31 more
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction6 Aug 2026
- 2026CADENA: Stepwise CAD Reverse Engineering1 Aug 2026
- 2026SceneActBench: Can Agents Act on the 3D Scenes They See?24 Jul 2026
- 2026Nova3D: Code-Native Generation of Programmable 3D Assets22 Jul 2026
- 2026Embodied CAD: Solver-Grounded LLM Agents for Parametric B-Rep Assembly Modeling30 Jun 2026
- 2026Enhancing Creativity in 3D Generative Design via a TRIZ-Inspired Text-to-CAD Framework19 Jun 2026
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning9 Jun 2026
- 2026Physics-in-the-Loop: A Hybrid Agentic Architecture for Validated CAD Engineering Design19 May 2026
- 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback17 May 2026
- 2026CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generation11 May 2026
- 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models3 May 2026
- 2026CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimization2 May 2026
- 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data27 Apr 2026
- 2026TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learning9 Apr 2026
- 2026GIFT: Bootstrapping Image-to-CAD Program Synthesis via Geometric Feedback28 Mar 2026
- 2026Agentic AI in Engineering and Manufacturing: Industry Perspectives on Utility, Adoption, Challenges, and Opportunities19 Mar 2026
- 2026SldprtNet: A Large-Scale Multimodal Dataset for CAD Generation in Language-Driven 3D Design13 Mar 2026
- 2026Design-Specification Tiling for ICL-based CAD Code Generation13 Mar 2026
- 2026Learning From Design Procedure To Generate CAD Programs for Data Augmentation6 Mar 2026
- 2026CADReasoner: Iterative Program Editing for CAD Reverse Engineering18 Feb 2026
- 2026Bioinspired123D: Generative 3D Modeling System for Bioinspired Structures11 Feb 2026
- 2026STEP-LLM: Generating CAD STEP Models from Natural Language with Large Language Models19 Jan 2026
- 2026Coding the Visual World: From Image to Simulation Using Vision Language Models8 Jan 2026
- 2025BrepLLM: Enabling Large Language Models to Understand Boundary Representations18 Dec 2025
- 2025A Survey of AI Methods for Geometry Preparation and Mesh Generation in Engineering Simulation16 Dec 2025
- 2025ReCAD: Reinforcement Learning Enhanced Parametric CAD Model Generation with Vision-Language Models6 Dec 2025
- 2025SciTextures: Collecting and Connecting Visual Patterns, Models, and Code Across Science and Art3 Nov 2025
- 2025EvoCAD: Evolutionary CAD Code Generation with Vision Language Models13 Oct 2025
- 2025GenCAD-3D: CAD Program Generation using Multimodal Latent Space Alignment and Synthetic Dataset Balancing17 Sep 2025
- 2025From Intent to Execution: Multimodal Chain-of-Thought Reinforcement Learning for Precise CAD Code Generation13 Aug 2025
- 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learning28 May 2025
- 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Datacited by 8
- 2026TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learningcited by 6
- 2026Embodied CAD: Solver-Grounded LLM Agents for Parametric B-Rep Assembly Modelingcited by 4
- 2026Physics-in-the-Loop: A Hybrid Agentic Architecture for Validated CAD Engineering Designcited by 3
- 2026CADForge: Agentic Single-View CAD Reconstruction with Explicit Geometry Reasoningcited by 1
- 2026Agentic AI in Engineering and Manufacturing: Industry Perspectives on Utility, Adoption, Challenges, and Opportunitiescited by 0
- 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editingcited by 0
- 2026CADForge: Agentic Single-View CAD Reconstruction with Explicit Geometry Reasoning3 Oct 2026
- 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editing28 Aug 2026
- 2026Embodied CAD: Solver-Grounded LLM Agents for Parametric B-Rep Assembly Modeling30 Jun 2026
- 2026Physics-in-the-Loop: A Hybrid Agentic Architecture for Validated CAD Engineering Design19 May 2026
- 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data27 Apr 2026
- 2026TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learning9 Apr 2026
- 2026Agentic AI in Engineering and Manufacturing: Industry Perspectives on Utility, Adoption, Challenges, and Opportunities19 Mar 2026
- 2025ReCAD: Reinforcement Learning Enhanced Parametric CAD Model Generation with Vision-Language Modelscited by 11
- 2026SceneActBench: Can Agents Act on the 3D Scenes They See?cited by 6
- 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Modelscited by 5
- 2026Coding the Visual World: From Image to Simulation Using Vision Language Modelscited by 0
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstructioncited by 0
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction6 Aug 2026
- 2026SceneActBench: Can Agents Act on the 3D Scenes They See?24 Jul 2026
- 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models3 May 2026
- 2026Coding the Visual World: From Image to Simulation Using Vision Language Models8 Jan 2026
- 2025ReCAD: Reinforcement Learning Enhanced Parametric CAD Model Generation with Vision-Language Models6 Dec 2025
- 2025From Intent to Execution: Multimodal Chain-of-Thought Reinforcement Learning for Precise CAD Code Generationcited by 12
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 9
- 2026OmniCAD: A Large-Scale Benchmark for 3D Spatial Reasoning in Robotics Assembliescited by 1
- 2026Test-Time Scaling for CAD Generation via Verifier-Free Consensus Selectioncited by 0
- 2026OmniCAD: A Large-Scale Benchmark for 3D Spatial Reasoning in Robotics Assemblies23 Aug 2026
- 2026Test-Time Scaling for CAD Generation via Verifier-Free Consensus Selection10 Aug 2026
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning9 Jun 2026
- 2025From Intent to Execution: Multimodal Chain-of-Thought Reinforcement Learning for Precise CAD Code Generation13 Aug 2025
- 2026CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generationcited by 11
- 2025GenCAD-3D: CAD Program Generation using Multimodal Latent Space Alignment and Synthetic Dataset Balancingcited by 8
- 2025EvoCAD: Evolutionary CAD Code Generation with Vision Language Modelscited by 6
- 2026CADReasoner: Iterative Program Editing for CAD Reverse Engineeringcited by 6
- 2026CADEngBench: It Looks Like CAD, but Does It Work? Evaluating Parametric Design, Assembly Reasoning, and Physics Simulationcited by 5
- 2026CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimizationcited by 4
- 2025A Survey of AI Methods for Geometry Preparation and Mesh Generation in Engineering Simulationcited by 3
- 2026GIFT: Bootstrapping Image-to-CAD Program Synthesis via Geometric Feedbackcited by 3
- 2026SldprtNet: A Large-Scale Multimodal Dataset for CAD Generation in Language-Driven 3D Designcited by 2
- 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedbackcited by 2
- 2026Nova3D: Code-Native Generation of Programmable 3D Assetscited by 2
- 2025SciTextures: Collecting and Connecting Visual Patterns, Models, and Code Across Science and Artcited by 1
12 most cited of 26 All 26 (JSON)
- 2026Rethinking Human Intent-to-CAD: Parametric CAD Model Generation via Cooperative Multi-Task Alignment and Spatial-Aware Reinforcement Learning11 Oct 2026
- 2026CADFather: Autonomous CAD Reconstruction through Coordinated Tool Use6 Oct 2026
- 2026StepCAD: Mesh-to-CAD Code Generation via LLM Policy and Geometry-Guided Search1 Oct 2026
- 2026ConCAD: Constraint-Aware Image-to-CAD Generation with Dual-Granularity Rewards28 Sep 2026
- 2026Vision2CAD: A Visual Agent Harness for Explicit Geometry Referencing and Localization in Parametric CAD Modeling19 Sep 2026
- 2026CIT-CAD: Constraint Intent Tree-based CAD Code Generation and Verification7 Sep 2026
- 2026CADEngBench: It Looks Like CAD, but Does It Work? Evaluating Parametric Design, Assembly Reasoning, and Physics Simulation10 Aug 2026
- 2026RA-CAD: Learning Post-Execution Critique for State-Aware Text-to-CAD Generation6 Aug 2026
- 2026CADENA: Stepwise CAD Reverse Engineering1 Aug 2026
- 2026Nova3D: Code-Native Generation of Programmable 3D Assets22 Jul 2026
- 2026Enhancing Creativity in 3D Generative Design via a TRIZ-Inspired Text-to-CAD Framework19 Jun 2026
- 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback17 May 2026
12 newest of 26 All 26 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilities
- 2026Foundation Models for Automatic CAD Generation
- 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
- 2025A Solver-Aided Hierarchical Language for LLM-Driven CAD Design
- 2025Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeek
- 2024From 2D CAD Drawings to 3D Parametric Models: A Vision-Language Approach
- 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editing
- 2025CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images