CADSmith: Multi-Agent CAD Generation with Programmatic Geometric Validation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Existing methods for text-to-CAD generation either operate in a single pass with no geometric verification or rely on lossy visual feedback that cannot resolve dimensional errors. We present CADSmith, a multi-agent pipeline that generates CadQuery code from natural language. It then undergoes an iterative refinement process through two nested correction loops: an inner loop that resolves execution errors and an outer loop grounded in programmatic geometric validation. The outer loop combines exact measurements from the OpenCASCADE kernel (bounding box dimensions, volume, solid validity) with holistic visual assessment from an independent vision-language model Judge. This provides both the numerical precision and the high-level shape awareness needed to converge on the correct geometry. The system uses retrieval-augmented generation over API documentation rather than fine-tuning, maintaining a current database as the underlying CAD library evolves. We evaluate on a custom benchmark of 100 prompts in three difficulty tiers (T1 through T3) with three ablation configurations. Against a zero-shot baseline, CADSmith achieves a 100% execution rate (up from 95%), improves the median F1 score from 0.9707 to 0.9846, the median IoU from 0.8085 to 0.9629, and reduces the mean Chamfer Distance from 28.37 to 0.74, demonstrating that closed-loop refinement with programmatic geometric feedback substantially improves the quality and reliability of LLM-generated CAD models.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 33 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
20 of 33 references.
References · 20
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategiescited by 236
- 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 151
- 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 118
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 74
8 more
- 20223DALL-E: Integrating Text-to-Image AI in 3D Design Workflowscited by 41
- 2024Query2CAD: Generating CAD models using natural language queriescited by 28
- 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Designcited by 26
- 2024Large Language Models for Manufacturingcited by 24
- 2024Text2CAD: Generating Sequential CAD Models from Beginner-to-Expert Level Text Promptscited by 22
- 2024Geometric Deep Learning for Computer-Aided Design: A Surveycited by 14
- 2023Conceptual Design Generation Using Large Language Modelscited by 13
- 2024Sketch2Prototype: Rapid Conceptual Design Exploration and Prototyping with Generative AIcited by 13
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026IterCAD: An Iterative Multimodal Agent for Visually-Grounded CAD Generation and Editingcited by 9
- 2026MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generationcited by 8
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoningcited by 8
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gapcited by 6
- 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedbackcited by 2
- 2026Nova3D: Code-Native Generation of Programmable 3D Assetscited by 1
- 2026Procedura: Agentic 3D Modeling with Procedural Controlcited by 1
- 2026Three-Phase Evaluation of AI-Assisted Software Development Life Cyclecited by 0
- 2026Test-Time Scaling for CAD Generation via Verifier-Free Consensus Selectioncited by 0
- 2026Vision2CAD: A Visual Agent Harness for Explicit Geometry Referencing and Localization in Parametric CAD Modelingcited by 0
- 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editingcited by 0
- 2026Vision2CAD: A Visual Agent Harness for Explicit Geometry Referencing and Localization in Parametric CAD Modeling19 Sep 2026
- 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editing28 Aug 2026
- 2026Procedura: Agentic 3D Modeling with Procedural Control26 Aug 2026
- 2026Test-Time Scaling for CAD Generation via Verifier-Free Consensus Selection10 Aug 2026
- 2026Nova3D: Code-Native Generation of Programmable 3D Assets22 Jul 2026
- 2026Three-Phase Evaluation of AI-Assisted Software Development Life Cycle6 Jul 2026
- 2026Autonomous Research Agents: A Survey of AI Scientists and the Verification Gap29 Jun 2026
- 2026IterCAD: An Iterative Multimodal Agent for Visually-Grounded CAD Generation and Editing11 Jun 2026
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning9 Jun 2026
- 2026MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generation27 May 2026
- 2026Self-Improving CAD Generation Agents with Finite Element Analysis as Feedback17 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Clarify Before You Draw: Proactive Agents for Robust Text-to-CAD Generation
- 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilities
- 2025CAD-Judge: Toward Efficient Morphological Grading and Verification for Text-to-CAD Generation
- 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data
- 2024Generating CAD Code with Vision-Language Models for 3D Designs
- 2025CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generation
- 2026RA-CAD: Learning Post-Execution Critique for State-Aware Text-to-CAD Generation
- 2026CADIR: A Cross-Backend Editable Intermediate Representation for Agentic CAD Generation