mlsanityData to 7 Oct 2026

STEP-LLM: Generating CAD STEP Models from Natural Language with Large Language Models

arXiv 2601.12641 ↗First posted 19 Jan 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Computer-aided design (CAD) is vital to modern manufacturing, yet model creation remains labor-intensive and expertise-heavy. To enable non-experts to translate intuitive design intent into manufacturable artifacts, recent large language models-based text-to-CAD efforts focus on command sequences or script-based formats like CadQuery. However, these formats are kernel-dependent and lack universality for manufacturing. In contrast, the Standard for the Exchange of Product Data (STEP, ISO 10303) file is a widely adopted, neutral boundary representation (B-rep) format directly compatible with manufacturing, but its graph-structured, cross-referenced nature poses unique challenges for auto-regressive LLMs. To address this, we curate a dataset of ~40K STEP-caption pairs and introduce novel preprocessing tailored for the graph-structured format of STEP, including a depth-first search-based reserialization that linearizes cross-references while preserving locality and chain-of-thought(CoT)-style structural annotations that guide global coherence. We integrate retrieval-augmented generation to ground predictions in relevant examples for supervised fine-tuning, and refine generation quality through reinforcement learning with a specific Chamfer Distance-based geometric reward. Experiments demonstrate consistent gains of our STEP-LLM in geometric fidelity over the Text2CAD baseline, with improvements arising from multiple stages of our framework: the RAG module substantially enhances completeness and renderability, the DFS-based reserialization strengthens overall accuracy, and the RL further reduces geometric discrepancy. Both metrics and visual comparisons confirm that STEP-LLM generates shapes with higher fidelity than Text2CAD. These results show the feasibility of LLM-driven STEP model generation from natural language, showing its potential to democratize CAD design for manufacturing.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 40 references that are in the map. First posted on arXiv 19 Jan 2026.

Builds on

31 of 40 references.

References · 31

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2024A Survey on Large Language Models for Code Generationcited by 646
  6. 2025The Lessons of Developing Process Reward Models in Mathematical Reasoningcited by 402
  7. 2024The Faiss librarycited by 370
  8. 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 339
  9. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
  10. 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 101
  11. 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 78
  12. 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 74
19 more
  1. 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilitiescited by 67
  2. 2025CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generationcited by 65
  3. 2025CAD-Coder: Text-to-CAD Generation with Chain-of-Thought and Geometric Rewardcited by 53
  4. 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 52
  5. 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilitiescited by 43
  6. 2025CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generationcited by 39
  7. 2023Empowering Autonomous Driving with Large Language Models: A Safety Perspectivecited by 34
  8. 2024Img2CAD: Reverse Engineering 3D CAD Models from Images through VLM-Assisted Conditional Factorizationcited by 34
  9. 2023Point2CAD: Reverse Engineering CAD Models from 3D Point Cloudscited by 33
  10. 2024FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Modelscited by 33
  11. 2024Query2CAD: Generating CAD models using natural language queriescited by 28
  12. 2024CadVLM: Bridging Language and Vision in the Generation of Parametric CAD Sketchescited by 28
  13. 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Designcited by 26
  14. 2025Shop-R1: Rewarding LLMs to Simulate Human Behavior in Online Shopping via Reinforcement Learningcited by 19
  15. 2025CAD-Judge: Toward Efficient Morphological Grading and Verification for Text-to-CAD Generationcited by 9
  16. 2025Token Buncher: Shielding LLMs from Harmful Reinforcement Learning Fine-Tuningcited by 7
  17. 2025Can LLMs Understand Unvoiced Speech? Exploring EMG-to-Text Conversion with LLMscited by 6
  18. 2025Graph-KV: Breaking Sequence via Injecting Structural Biases into Large Language Modelscited by 6
  19. 2025Shedding Light on VLN Robustness: A Black-box Framework for Indoor Lighting-based Adversarial Attackcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Text-to-CAD Retrieval: a Strong Baseline
  2. 2026MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generation
  3. 2025Error Notebook-Guided, Training-Free Part Retrieval in 3D CAD Assemblies via Vision-Language Models
  4. 2025Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeek
  5. 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvement
  6. 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
  7. 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models
  8. 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editing