SldprtNet: A Large-Scale Multimodal Dataset for CAD Generation in Language-Driven 3D Design
Not on the map. Why?
Abstract (arXiv)
We introduce SldprtNet, a large-scale dataset comprising over 242,000 industrial parts, designed for semantic-driven CAD modeling, geometric deep learning, and the training and fine-tuning of multimodal models for 3D design. The dataset provides 3D models in both .step and .sldprt formats to support diverse training and testing. To enable parametric modeling and facilitate dataset scalability, we developed supporting tools, an encoder and a decoder, which support 13 types of CAD commands and enable lossless transformation between 3D models and a structured text representation. Additionally, each sample is paired with a composite image created by merging seven rendered views from different viewpoints of the 3D model, effectively reducing input token length and accelerating inference. By combining this image with the parameterized text output from the encoder, we employ the lightweight multimodal language model Qwen2.5-VL-7B to generate a natural language description of each part's appearance and functionality. To ensure accuracy, we manually verified and aligned the generated descriptions, rendered images, and 3D models. These descriptions, along with the parameterized modeling scripts, rendered images, and 3D model files, are fully aligned to construct SldprtNet. To assess its effectiveness, we fine-tuned baseline models on a dataset subset, comparing image-plus-text inputs with text-only inputs. Results confirm the necessity and value of multimodal datasets for CAD generation. It features carefully selected real-world industrial parts, supporting tools for scalable dataset expansion, diverse modalities, and ensured diversity in model complexity and geometric features, making it a comprehensive multimodal dataset built for semantic-driven CAD modeling and cross-modal learning.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 48 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
34 of 48 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2023Mistral 7Bcited by 3,065
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
22 more
- 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 339
- 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2016Thingi10K: A Dataset of 10,000 3D-Printing Modelscited by 182
- 2023Hierarchical Neural Coding for Controllable CAD Model Generationcited by 84
- 2021Computer-Aided Design as Languagecited by 82
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 74
- 2020SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Designcited by 72
- 2016SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentationcited by 70
- 2021SketchGen: Generating Constrained CAD Sketchescited by 68
- 2021Vitruvion: A Generative Model of Parametric CAD Sketchescited by 66
- 2023T3Bench: Benchmarking Current Progress in Text-to-3D Generationcited by 56
- 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 52
- 2022CLIP-Sculptor: Zero-Shot Generation of High-Fidelity and Diverse Shapes from Natural Languagecited by 46
- 2025CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generationcited by 39
- 2022CADOps-Net: Jointly Learning CAD Operation Types and Steps from Boundary-Representationscited by 30
- 2023Neurosymbolic Models for Computer Graphicscited by 27
- 2024Text2CAD: Generating Sequential CAD Models from Beginner-to-Expert Level Text Promptscited by 22
- 2021PvDeConv: Point-Voxel Deconvolution for Autoencoding CAD Construction in 3Dcited by 20
- 2023SHARP Challenge 2023: Solving CAD History and pArameters Recovery from Point clouds and 3D scans. Overview, Datasets, Metrics, and Baselinescited by 19
- 2019Neural Shape Parsers for Constructive Solid Geometrycited by 14
- 2021'CADSketchNet' -- An Annotated Sketch dataset for 3D CAD Model Retrieval with Deep Neural Networkscited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models
- 2025GenCAD-3D: CAD Program Generation using Multimodal Latent Space Alignment and Synthetic Dataset Balancing
- 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learning
- 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Design
- 2024From 2D CAD Drawings to 3D Parametric Models: A Vision-Language Approach
- 2026Foundation Models for Automatic CAD Generation
- 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilities
- 2024CadVLM: Bridging Language and Vision in the Generation of Parametric CAD Sketches