mlsanityData to 7 Oct 2026

Clarify Before You Draw: Proactive Agents for Robust Text-to-CAD Generation

arXiv 2602.03045 ↗First posted 3 Feb 2026cs.LGcited by 7

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Large language models have recently enabled text-to-CAD systems that synthesize parametric CAD programs (e.g., CadQuery) from natural-language prompts. In practice, however, geometric descriptions can be under-specified or internally inconsistent: critical dimensions may be missing and constraints may conflict. However, existing fine-tuned models tend to reactively follow the user instructions and hallucinate dimensions when the text is ambiguous. To address this, we propose a proactive agentic framework for text-to-CadQuery generation, named as ProCAD, that resolves specification issues before code synthesis. Our framework pairs a proactive clarifying agent, which audits the prompt and asks targeted clarification questions only when necessary to produce a self-consistent specification, with a CAD coding agent that translates the specification into an executable CadQuery program. We fine-tune the coding agent based on a curated high-quality text-to-CadQuery dataset and train the clarifying agent via agentic SFT on clarification trajectories. Experiments show that proactive clarification significantly improves robustness to ambiguous prompts while keeping interaction overhead low. ProCAD outperforms frontier closed-source models, including Claude Sonnet 4.5, reducing the mean Chamfer distance by 79.9% and lowering the invalidity ratio from 4.8% to 0.9%. Our code and datasets are made publicly available on https://github.com/BoYuanVisionary/Pro-CAD.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 39 of its 55 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

39 of 55 references.

References · 39

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2021Program Synthesis with Large Language Modelscited by 3,509
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  6. 2016Concrete Problems in AI Safetycited by 1,582
  7. 2025OpenAI GPT-5 System Cardcited by 910
  8. 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 865
  9. 2024A Survey on Large Language Models for Code Generationcited by 646
  10. 2024Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language Modelscited by 282
  11. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
  12. 2023Multimodal Deep Learningcited by 257
27 more
  1. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 249
  2. 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 121
  3. 2023Verbosity Bias in Preference Labeling by Large Language Modelscited by 89
  4. 2023Hierarchical Neural Coding for Controllable CAD Model Generationcited by 84
  5. 2024Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistancecited by 84
  6. 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 74
  7. 2025CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generationcited by 65
  8. 2024CAD-Recode: Reverse Engineering CAD Code from Point Cloudscited by 63
  9. 2024CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attentioncited by 62
  10. 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 61
  11. 2025CAD-Coder: Text-to-CAD Generation with Chain-of-Thought and Geometric Rewardcited by 53
  12. 2025Text-to-CAD Generation Through Infusing Visual Feedback in Large Language Modelscited by 43
  13. 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilitiescited by 43
  14. 2025Training Proactive and Personalized LLM Agentscited by 42
  15. 2024LLM-Powered User Simulator for Recommender Systemcited by 38
  16. 2024FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Modelscited by 33
  17. 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questionscited by 32
  18. 2024Query2CAD: Generating CAD models using natural language queriescited by 28
  19. 2024Reliable LLM-based User Simulator for Task-Oriented Dialogue Systemscited by 24
  20. 2025EffiBench-X: A Multi-Language Benchmark for Measuring Efficiency of LLM-Generated Codecited by 24
  21. 2025CADmium: Fine-Tuning Code Language Models for Text-Driven Sequential CAD Designcited by 23
  22. 2025Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeekcited by 22
  23. 2021ProTo: Program-Guided Transformer for Program-Guided Taskscited by 19
  24. 2025MEML-GRPO: Heterogeneous Multi-Expert Mutual Learning for RLVR Advancementcited by 14
  25. 2025From Intent to Execution: Multimodal Chain-of-Thought Reinforcement Learning for Precise CAD Code Generationcited by 10
  26. 2024Grounding and Enhancing Grid-based Models for Neural Fieldscited by 8
  27. 2020Augmenting Policy Learning with Routines Discovered from a Single Demonstrationcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026CADSmith: Multi-Agent CAD Generation with Programmatic Geometric Validation
  2. 2025CAD-Judge: Toward Efficient Morphological Grading and Verification for Text-to-CAD Generation
  3. 2026TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learning
  4. 2026ArtisanCAD: An Industrial-Level CAD Agent with Expert-Grounded Knowledge Distillation
  5. 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data
  6. 2026Test-Time Scaling for CAD Generation via Verifier-Free Consensus Selection
  7. 2024An Agentic Approach to Automatic Creation of P&ID Diagrams from Natural Language Descriptions
  8. 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editing