UniCAD: A Unified Benchmark and Universal Model for Multi-Modal Multi-Task CAD
Not on the map. Why?
Abstract (arXiv)
Computer-Aided Design (CAD) underpins modern engineering and manufacturing by enabling the creation of precise, editable 3D models. However, CAD research typically studies tasks in isolation, and multi-modal, multi-task learning for CAD is hindered by the absence of a unified benchmark. To address this gap, we introduce UniCAD, a comprehensive benchmark for multi-modal CAD learning that covers point-to-CAD reconstruction, text/image-to-CAD generation, and CAD question answering across diverse input modalities. Alongside the benchmark, we present UniCAD-MLLM, a universal multi-modal large language model that ingests text, images, sketches, and point clouds and performs these heterogeneous tasks in an end-to-end fashion within a single framework. Extensive experiments on the UniCAD and Fusion360 benchmarks demonstrate that UniCAD-MLLM achieves state-of-the-art performance across all tasks, outperforming existing task-specific and multi-task baselines. We will release the dataset, code, and pretrained models to accelerate future research.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 37 of its 60 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
37 of 60 references.
References · 37
- 2017Attention Is All You Needcited by 60,361
- 2023GPT-4 Technical Reportcited by 18,396
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Qwen2 Technical Reportcited by 2,120
- 2025Qwen-Image Technical Reportcited by 1,044
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
- 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 269
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
25 more
- 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 125
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 103
- 2020ParSeNet: A Parametric Surface Fitting Network for 3D Point Cloudscited by 96
- 2018Supervised Fitting of Geometric Primitives to 3D Point Cloudscited by 91
- 2023Hierarchical Neural Coding for Controllable CAD Model Generationcited by 86
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 81
- 2020SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Designcited by 72
- 2020PIE-NET: Parametric Inference of Point Cloud Edgescited by 67
- 2024CAD-Recode: Reverse Engineering CAD Code from Point Cloudscited by 66
- 2024CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attentioncited by 64
- 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 62
- 2021Point2Cyl: Reverse Engineering 3D Objects from Point Clouds to Extrusion Cylinderscited by 60
- 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 53
- 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilitiescited by 43
- 2022Reconstructing editable prismatic CAD from rounded voxel modelscited by 41
- 2024CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solverscited by 40
- 2024GenCAD: Image-Conditioned Computer-Aided Design Generation with Transformer-Based Contrastive Representation and Diffusion Priorscited by 38
- 2024Img2CAD: Conditioned 3D CAD Model Generation from Single Image with Structured Visual Geometrycited by 37
- 2024Img2CAD: Reverse Engineering 3D CAD Models from Images through VLM-Assisted Conditional Factorizationcited by 35
- 2024Can Large Language Models Understand Symbolic Graphics Programs?cited by 35
- 2024Query2CAD: Generating CAD models using natural language queriescited by 29
- 2024TransCAD: A Hierarchical Transformer for CAD Sequence Inference from Point Cloudscited by 29
- 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Designcited by 26
- 2025Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeekcited by 24
- 2022Neural Face Identification in a 2D Wireframe Projection of a Manifold Objectcited by 18
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learning
- 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
- 2026CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generation
- 2026Text-to-CAD Retrieval: a Strong Baseline
- 2026BrepCoder: A Unified Multimodal Large Language Model for Multi-task B-rep Reasoning
- 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editing
- 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvement
- 2026PR-CAD: Progressive Refinement for Unified Controllable and Faithful Text-to-CAD Generation with Large Language Models