Text-to-CAD Evaluation with CADTests
Not on the map. Why?
Abstract (arXiv)
Text-to-CAD has recently emerged as an important task with the potential to substantially accelerate design workflows. Despite its significance, there has been surprisingly little work on Text-to-CAD evaluation, and assessing CAD model generation performance remains a considerable challenge. In this work, we introduce a new evaluation perspective for Text-to-CAD based on automated testing. We propose CADTestBench, the first test-based benchmark for Text-to-CAD, based on CADTests, executable software tests that verify whether a generated CAD model satisfies the geometric and topological requirements of the input prompt. Using CADTestBench, we conduct comprehensive benchmarking of recent Text-to-CAD methods and further demonstrate that CADTests can also guide CAD model generation, yielding simple baselines that surpass performance of current methods. CADTestBench code and data are available at GitHub and Hugging Face dataset.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 31 of its 45 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
31 of 45 references.
References · 31
- 2023GPT-4 Technical Reportcited by 18,396
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2021Measuring Coding Challenge Competence With APPScited by 902
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
- 2020Unsupervised Translation of Programming Languagescited by 263
- 2019SPoC: Search-based Pseudocode to Codecited by 176
- 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
- 2021BRepNet: A topological message passing system for solid modelscited by 95
19 more
- 2025CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generationcited by 67
- 2021Vitruvion: A Generative Model of Parametric CAD Sketchescited by 66
- 2024CAD-Recode: Reverse Engineering CAD Code from Point Cloudscited by 66
- 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 62
- 2021Point2Cyl: Reverse Engineering 3D Objects from Point Clouds to Extrusion Cylinderscited by 60
- 2025CAD-Coder: Text-to-CAD Generation with Chain-of-Thought and Geometric Rewardcited by 56
- 2025Text-to-CAD Generation Through Infusing Visual Feedback in Large Language Modelscited by 47
- 2024CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solverscited by 40
- 2024FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Modelscited by 34
- 2023Can Large Language Models Write Good Property-Based Tests?cited by 31
- 2024Query2CAD: Generating CAD models using natural language queriescited by 29
- 2024TransCAD: A Hierarchical Transformer for CAD Sequence Inference from Point Cloudscited by 29
- 2023SHARP Challenge 2023: Solving CAD History and pArameters Recovery from Point clouds and 3D scans. Overview, Datasets, Metrics, and Baselinescited by 19
- 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editingcited by 19
- 2025From Idea to CAD: A Language Model-Driven Multi-Agent System for Collaborative Designcited by 14
- 2024Text2CAD: Text to 3D CAD Generation via Technical Drawingscited by 10
- 2024PICASSO: A Feed-Forward Framework for Parametric Inference of CAD Sketches via Rendering Self-Supervisioncited by 9
- 2024DAVINCI: A Single-Stage Architecture for Constrained CAD Sketch Inferencecited by 6
- 2025MiCADangelo: Fine-Grained Reconstruction of Constrained CAD Models from 3D Scanscited by 5
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026CADEngBench: It Looks Like CAD, but Does It Work? Evaluating Parametric Design, Assembly Reasoning, and Physics Simulationcited by 5
- 2026Nova3D: Code-Native Generation of Programmable 3D Assetscited by 2
- 2026CADENA: Stepwise CAD Reverse Engineeringcited by 1
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Modelscited by 1
- 2026CADWorld: Computer-Use Benchmark for Long-Horizon Computer-Aided Designcited by 1
- 2026Wrong Design Intent Is Worse Than Never Conditioning: A Derangement-Control Diagnosis of Header Conditioning in CAD Program Completioncited by 0
- 2026MechReason: Benchmarking Multi-Image Multi-Hop Reasoning in Mechanical Engineeringcited by 0
- 2026PolyBridgeBench: Benchmarking Multimodal LLMs for Physics-Grounded Bridge Designcited by 0
- 2026EngiWorld: What Can Frontier Agents Deliver in Professional Engineering Environments?cited by 0
- 20262d-fet-bench: from spatial reasoning to fet design on flakescited by 0
- 20262d-fet-bench: from spatial reasoning to fet design on flakes5 Oct 2026
- 2026EngiWorld: What Can Frontier Agents Deliver in Professional Engineering Environments?29 Sep 2026
- 2026PolyBridgeBench: Benchmarking Multimodal LLMs for Physics-Grounded Bridge Design18 Sep 2026
- 2026CADWorld: Computer-Use Benchmark for Long-Horizon Computer-Aided Design14 Sep 2026
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Models6 Sep 2026
- 2026MechReason: Benchmarking Multi-Image Multi-Hop Reasoning in Mechanical Engineering21 Aug 2026
- 2026CADEngBench: It Looks Like CAD, but Does It Work? Evaluating Parametric Design, Assembly Reasoning, and Physics Simulation10 Aug 2026
- 2026CADENA: Stepwise CAD Reverse Engineering1 Aug 2026
- 2026Wrong Design Intent Is Worse Than Never Conditioning: A Derangement-Control Diagnosis of Header Conditioning in CAD Program Completion25 Jul 2026
- 2026Nova3D: Code-Native Generation of Programmable 3D Assets22 Jul 2026