mlsanityData to 14 Oct 2026

CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generation

arXiv 2505.14646 ↗First posted 20 May 2025cs.CV cs.AIcited by 43

Not on the map. Why?

Abstract (arXiv)

Efficient creation of accurate and editable 3D CAD models is critical in engineering design, significantly impacting cost and time-to-market in product innovation. Current manual workflows remain highly time-consuming and demand extensive user expertise. While recent developments in AI-driven CAD generation show promise, existing models are limited by incomplete representations of CAD operations, inability to generalize to real-world images, and low output accuracy. This paper introduces CAD-Coder, an open-source Vision-Language Model (VLM) explicitly fine-tuned to generate editable CAD code (CadQuery Python) directly from visual input. Leveraging a novel dataset that we created--GenCAD-Code, consisting of over 163k CAD-model image and code pairs--CAD-Coder outperforms state-of-the-art VLM baselines such as GPT-4.5 and Qwen2.5-VL-72B, achieving a 100% valid syntax rate and the highest accuracy in 3D solid similarity. Notably, our VLM demonstrates some signs of generalizability, successfully generating CAD code from real-world images and executing CAD operations unseen during fine-tuning. The performance and adaptability of CAD-Coder highlights the potential of VLMs fine-tuned on code to streamline CAD workflows for engineers and designers. CAD-Coder is publicly available at: https://github.com/anniedoris/CAD-Coder.

Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). Builds on 29 of its 34 references that are in the map. First posted on arXiv 20 May 2025.

Builds on

29 of 34 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  6. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
  7. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
  8. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  9. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
  10. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  11. 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
  12. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
17 more
  1. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
  2. 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 125
  3. 2017CSGNet: Neural Shape Parser for Constructive Solid Geometrycited by 106
  4. 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 103
  5. 2023Fine-tuning can cripple your foundation model; preserving features may be the solutioncited by 96
  6. 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 80
  7. 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
  8. 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 62
  9. 2021Engineering Sketch Generation for Computer-Aided Designcited by 49
  10. 2024CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solverscited by 40
  11. 2024GenCAD: Image-Conditioned Computer-Aided Design Generation with Transformer-Based Contrastive Representation and Diffusion Priorscited by 38
  12. 2025Activation-Informed Merging of Large Language Modelscited by 30
  13. 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvementcited by 29
  14. 2024CadVLM: Bridging Language and Vision in the Generation of Parametric CAD Sketchescited by 28
  15. 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Designcited by 26
  16. 2025From Idea to CAD: A Language Model-Driven Multi-Agent System for Collaborative Designcited by 14
  17. 2021Deep Learning for Technical Document Classificationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 35.

43 papers.

Sort:

By area:

  1. 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learningcited by 16
  2. 2025From Intent to Execution: Multimodal Chain-of-Thought Reinforcement Learning for Precise CAD Code Generationcited by 12
  3. 2025ReCAD: Reinforcement Learning Enhanced Parametric CAD Model Generation with Vision-Language Modelscited by 11
  4. 2026CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generationcited by 11
  5. 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 9
  6. 2025GenCAD-3D: CAD Program Generation using Multimodal Latent Space Alignment and Synthetic Dataset Balancingcited by 8
  7. 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Datacited by 8
  8. 2025EvoCAD: Evolutionary CAD Code Generation with Vision Language Modelscited by 6
  9. 2026CADReasoner: Iterative Program Editing for CAD Reverse Engineeringcited by 6
  10. 2026TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learningcited by 6
  11. 2026SceneActBench: Can Agents Act on the 3D Scenes They See?cited by 6
  12. 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Modelscited by 5
31 more
  1. 2026CADEngBench: It Looks Like CAD, but Does It Work? Evaluating Parametric Design, Assembly Reasoning, and Physics Simulationcited by 5
  2. 2026CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimizationcited by 4
  3. 2026Embodied CAD: Solver-Grounded LLM Agents for Parametric B-Rep Assembly Modelingcited by 4
  4. 2025A Survey of AI Methods for Geometry Preparation and Mesh Generation in Engineering Simulationcited by 3
  5. 2026GIFT: Bootstrapping Image-to-CAD Program Synthesis via Geometric Feedbackcited by 3
  6. 2026Physics-in-the-Loop: A Hybrid Agentic Architecture for Validated CAD Engineering Designcited by 3
  7. 2026SldprtNet: A Large-Scale Multimodal Dataset for CAD Generation in Language-Driven 3D Designcited by 2
  8. 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedbackcited by 2
  9. 2026Nova3D: Code-Native Generation of Programmable 3D Assetscited by 2
  10. 2025SciTextures: Collecting and Connecting Visual Patterns, Models, and Code Across Science and Artcited by 1
  11. 2025BrepLLM: Enabling Large Language Models to Understand Boundary Representationscited by 1
  12. 2026STEP-LLM: Generating CAD STEP Models from Natural Language with Large Language Modelscited by 1
  13. 2026CADENA: Stepwise CAD Reverse Engineeringcited by 1
  14. 2026OmniCAD: A Large-Scale Benchmark for 3D Spatial Reasoning in Robotics Assembliescited by 1
  15. 2026CADForge: Agentic Single-View CAD Reconstruction with Explicit Geometry Reasoningcited by 1
  16. 2026Coding the Visual World: From Image to Simulation Using Vision Language Modelscited by 0
  17. 2026Learning From Design Procedure To Generate CAD Programs for Data Augmentationcited by 0
  18. 2026Design-Specification Tiling for ICL-based CAD Code Generationcited by 0
  19. 2026Bioinspired123D: Generative 3D Modeling System for Bioinspired Structurescited by 0
  20. 2026Agentic AI in Engineering and Manufacturing: Industry Perspectives on Utility, Adoption, Challenges, and Opportunitiescited by 0
  21. 2026Enhancing Creativity in 3D Generative Design via a TRIZ-Inspired Text-to-CAD Frameworkcited by 0
  22. 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstructioncited by 0
  23. 2026RA-CAD: Learning Post-Execution Critique for State-Aware Text-to-CAD Generationcited by 0
  24. 2026Test-Time Scaling for CAD Generation via Verifier-Free Consensus Selectioncited by 0
  25. 2026CIT-CAD: Constraint Intent Tree-based CAD Code Generation and Verificationcited by 0
  26. 2026Vision2CAD: A Visual Agent Harness for Explicit Geometry Referencing and Localization in Parametric CAD Modelingcited by 0
  27. 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editingcited by 0
  28. 2026ConCAD: Constraint-Aware Image-to-CAD Generation with Dual-Granularity Rewardscited by 0
  29. 2026StepCAD: Mesh-to-CAD Code Generation via LLM Policy and Geometry-Guided Searchcited by 0
  30. 2026CADFather: Autonomous CAD Reconstruction through Coordinated Tool Usecited by 0
  31. 2026Rethinking Human Intent-to-CAD: Parametric CAD Model Generation via Cooperative Multi-Task Alignment and Spatial-Aware Reinforcement Learningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilities
  2. 2026Foundation Models for Automatic CAD Generation
  3. 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
  4. 2025A Solver-Aided Hierarchical Language for LLM-Driven CAD Design
  5. 2025Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeek
  6. 2024From 2D CAD Drawings to 3D Parametric Models: A Vision-Language Approach
  7. 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editing
  8. 2025CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images