STEP-LLM: Generating CAD STEP Models from Natural Language with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Computer-aided design (CAD) is vital to modern manufacturing, yet model creation remains labor-intensive and expertise-heavy. To enable non-experts to translate intuitive design intent into manufacturable artifacts, recent large language models-based text-to-CAD efforts focus on command sequences or script-based formats like CadQuery. However, these formats are kernel-dependent and lack universality for manufacturing. In contrast, the Standard for the Exchange of Product Data (STEP, ISO 10303) file is a widely adopted, neutral boundary representation (B-rep) format directly compatible with manufacturing, but its graph-structured, cross-referenced nature poses unique challenges for auto-regressive LLMs. To address this, we curate a dataset of ~40K STEP-caption pairs and introduce novel preprocessing tailored for the graph-structured format of STEP, including a depth-first search-based reserialization that linearizes cross-references while preserving locality and chain-of-thought(CoT)-style structural annotations that guide global coherence. We integrate retrieval-augmented generation to ground predictions in relevant examples for supervised fine-tuning, and refine generation quality through reinforcement learning with a specific Chamfer Distance-based geometric reward. Experiments demonstrate consistent gains of our STEP-LLM in geometric fidelity over the Text2CAD baseline, with improvements arising from multiple stages of our framework: the RAG module substantially enhances completeness and renderability, the DFS-based reserialization strengthens overall accuracy, and the RL further reduces geometric discrepancy. Both metrics and visual comparisons confirm that STEP-LLM generates shapes with higher fidelity than Text2CAD. These results show the feasibility of LLM-driven STEP model generation from natural language, showing its potential to democratize CAD design for manufacturing.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 40 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
31 of 40 references.
References · 31
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2024A Survey on Large Language Models for Code Generationcited by 646
- 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 402
- 2024The Faiss librarycited by 370
- 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 339
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 101
- 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 78
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 74
19 more
- 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilitiescited by 67
- 2025CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generationcited by 65
- 2025CAD-Coder: Text-to-CAD Generation with Chain-of-Thought and Geometric Rewardcited by 53
- 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 52
- 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilitiescited by 43
- 2025CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generationcited by 39
- 2023Empowering Autonomous Driving with Large Language Models: A Safety Perspectivecited by 34
- 2024Img2CAD: Reverse Engineering 3D CAD Models from Images through VLM-Assisted Conditional Factorizationcited by 34
- 2023Point2CAD: Reverse Engineering CAD Models from 3D Point Cloudscited by 33
- 2024FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Modelscited by 33
- 2024Query2CAD: Generating CAD models using natural language queriescited by 28
- 2024CadVLM: Bridging Language and Vision in the Generation of Parametric CAD Sketchescited by 28
- 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Designcited by 26
- 2025Shop-R1: Rewarding LLMs to Simulate Human Behavior in Online Shopping via Reinforcement Learningcited by 19
- 2025CAD-Judge: Toward Efficient Morphological Grading and Verification for Text-to-CAD Generationcited by 9
- 2025Token Buncher: Shielding LLMs from Harmful Reinforcement Learning Fine-Tuningcited by 7
- 2025Can LLMs Understand Unvoiced Speech? Exploring EMG-to-Text Conversion with LLMscited by 6
- 2025Graph-KV: Breaking Sequence via Injecting Structural Biases into Large Language Modelscited by 6
- 2025Shedding Light on VLN Robustness: A Black-box Framework for Indoor Lighting-based Adversarial Attackcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Text-to-CAD Retrieval: a Strong Baseline
- 2026MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generation
- 2025Error Notebook-Guided, Training-Free Part Retrieval in 3D CAD Assemblies via Vision-Language Models
- 2025Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeek
- 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvement
- 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
- 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models
- 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editing