BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
Not on the map. Why?
Abstract (arXiv)
Industrial Computer-Aided Design (CAD) code generation requires models to produce executable parametric programs from visual or textual inputs. Beyond recognizing the outer shape of a part, this task involves understanding its 3D structure, inferring engineering parameters, and choosing CAD operations that reflect how the part would be designed and manufactured. Despite the promise of Multimodal large language models (MLLMs) for this task, they are rarely evaluated on whether these capabilities jointly hold in realistic industrial CAD settings. We present BenchCAD, a unified benchmark for industrial CAD reasoning. BenchCAD contains 17,900 execution-verified CadQuery programs across 106 industrial part families, including bevel gears, compression springs, twist drills, and other reusable engineering designs. It evaluates models through visual question answering, code question answering, image-to-code generation, and instruction-guided code editing, enabling fine-grained analysis across perception, parametric abstraction, and executable program synthesis. Across 10+ frontier models, BenchCAD shows that current systems often recover coarse outer geometry but fail to produce faithful parametric CAD programs. Common failures include missing fine 3D structure, misinterpreting industrial design parameters, and replacing essential operations such as sweeps, lofts, and twist-extrudes with simpler sketch-and-extrude patterns. Fine-tuning and reinforcement learning improve in-distribution performance, but generalization to unseen part families remains limited. These results position BenchCAD as a benchmark for measuring and improving the industrial readiness of multimodal CAD automation.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 7 of its 18 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
7 of 18 references.
References · 7
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
- 2024Croissant: A Metadata Format for ML-Ready Datasetscited by 81
- 2024CAD-Recode: Reverse Engineering CAD Code from Point Cloudscited by 66
- 2025CAD-Coder: Text-to-CAD Generation with Chain-of-Thought and Geometric Rewardcited by 56
- 2024Text2CAD: Generating Sequential CAD Models from Beginner-to-Expert Level Text Promptscited by 23
- 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editingcited by 19
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 9
- 2026CADENA: Stepwise CAD Reverse Engineeringcited by 1
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Modelscited by 1
- 2026CADWorld: Computer-Use Benchmark for Long-Horizon Computer-Aided Designcited by 1
- 2026Prompting Image Generators for Training-free Primitive Shape Abstractioncited by 0
- 2026An Exam for Active Observerscited by 0
- 2026RealCADBench: Benchmarking Parametric CAD Modeling from Industrial Design Intentscited by 0
- 2026VisCAD: A Foundation Model Suite with Multimodal Industrial CAD Intelligencecited by 0
- 2026DepthBenchCAD: When Does Deeper Auditing Yield More Reliable Conclusions?cited by 0
- 2026MechReason: Benchmarking Multi-Image Multi-Hop Reasoning in Mechanical Engineeringcited by 0
- 20262d-fet-bench: from spatial reasoning to fet design on flakescited by 0
- 2026CADFather: Autonomous CAD Reconstruction through Coordinated Tool Usecited by 0
- 2026ExeWorldBench: Benchmarking Code-Based Executable 3D World Modeling10 Oct 2026
- 2026Mind the Spatial Gap: A Benchmark for Geospatial Reasoning and Constrained Spatial Editing9 Oct 2026
- 2026BrickBench: Evaluating Agentic Brick Design8 Oct 2026
- 2026CADFather: Autonomous CAD Reconstruction through Coordinated Tool Use6 Oct 2026
- 20262d-fet-bench: from spatial reasoning to fet design on flakes5 Oct 2026
- 2026CADWorld: Computer-Use Benchmark for Long-Horizon Computer-Aided Design14 Sep 2026
- 2026DepthBenchCAD: When Does Deeper Auditing Yield More Reliable Conclusions?14 Sep 2026
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Models6 Sep 2026
- 2026VisCAD: A Foundation Model Suite with Multimodal Industrial CAD Intelligence3 Sep 2026
- 2026RealCADBench: Benchmarking Parametric CAD Modeling from Industrial Design Intents3 Sep 2026
- 2026MechReason: Benchmarking Multi-Image Multi-Hop Reasoning in Mechanical Engineering21 Aug 2026
- 2026CADENA: Stepwise CAD Reverse Engineering1 Aug 2026
3 more
- 2026BrickBench: Evaluating Agentic Brick Design8 Oct 2026
- 2026CADWorld: Computer-Use Benchmark for Long-Horizon Computer-Aided Design14 Sep 2026
- 2026CADENA: Stepwise CAD Reverse Engineeringcited by 1
- 2026Prompting Image Generators for Training-free Primitive Shape Abstractioncited by 0
- 2026An Exam for Active Observerscited by 0
- 2026RealCADBench: Benchmarking Parametric CAD Modeling from Industrial Design Intentscited by 0
- 2026VisCAD: A Foundation Model Suite with Multimodal Industrial CAD Intelligencecited by 0
- 2026DepthBenchCAD: When Does Deeper Auditing Yield More Reliable Conclusions?cited by 0
- 2026CADFather: Autonomous CAD Reconstruction through Coordinated Tool Usecited by 0
- 2026CADFather: Autonomous CAD Reconstruction through Coordinated Tool Use6 Oct 2026
- 2026DepthBenchCAD: When Does Deeper Auditing Yield More Reliable Conclusions?14 Sep 2026
- 2026VisCAD: A Foundation Model Suite with Multimodal Industrial CAD Intelligence3 Sep 2026
- 2026RealCADBench: Benchmarking Parametric CAD Modeling from Industrial Design Intents3 Sep 2026
- 2026CADENA: Stepwise CAD Reverse Engineering1 Aug 2026
- 2026An Exam for Active Observers17 Jul 2026
- 2026Prompting Image Generators for Training-free Primitive Shape Abstraction6 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generation
- 2026MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generation
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction
- 2025CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generation
- 2026Pointer-CAD v2: Plan-Then-Construct CAD Generation with Dimension-Aware Parametric Precision
- 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data
- 2026ArtisanCAD: An Industrial-Level CAD Agent with Expert-Grounded Knowledge Distillation
- 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models