mlsanityData to 14 Oct 2026

UniCAD: A Unified Benchmark and Universal Model for Multi-Modal Multi-Task CAD

arXiv 2606.05058 ↗First posted 3 Jun 2026cs.CV cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Computer-Aided Design (CAD) underpins modern engineering and manufacturing by enabling the creation of precise, editable 3D models. However, CAD research typically studies tasks in isolation, and multi-modal, multi-task learning for CAD is hindered by the absence of a unified benchmark. To address this gap, we introduce UniCAD, a comprehensive benchmark for multi-modal CAD learning that covers point-to-CAD reconstruction, text/image-to-CAD generation, and CAD question answering across diverse input modalities. Alongside the benchmark, we present UniCAD-MLLM, a universal multi-modal large language model that ingests text, images, sketches, and point clouds and performs these heterogeneous tasks in an end-to-end fashion within a single framework. Extensive experiments on the UniCAD and Fusion360 benchmarks demonstrate that UniCAD-MLLM achieves state-of-the-art performance across all tasks, outperforming existing task-specific and multi-task baselines. We will release the dataset, code, and pretrained models to accelerate future research.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 37 of its 60 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

37 of 60 references.

References · 37

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2024Qwen2 Technical Reportcited by 2,120
  6. 2025Qwen-Image Technical Reportcited by 1,044
  7. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  8. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  9. 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
  10. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
  11. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 269
  12. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
25 more
  1. 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 125
  2. 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 103
  3. 2020ParSeNet: A Parametric Surface Fitting Network for 3D Point Cloudscited by 96
  4. 2018Supervised Fitting of Geometric Primitives to 3D Point Cloudscited by 91
  5. 2023Hierarchical Neural Coding for Controllable CAD Model Generationcited by 86
  6. 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 81
  7. 2020SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Designcited by 72
  8. 2020PIE-NET: Parametric Inference of Point Cloud Edgescited by 67
  9. 2024CAD-Recode: Reverse Engineering CAD Code from Point Cloudscited by 66
  10. 2024CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attentioncited by 64
  11. 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 62
  12. 2021Point2Cyl: Reverse Engineering 3D Objects from Point Clouds to Extrusion Cylinderscited by 60
  13. 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 53
  14. 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilitiescited by 43
  15. 2022Reconstructing editable prismatic CAD from rounded voxel modelscited by 41
  16. 2024CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solverscited by 40
  17. 2024GenCAD: Image-Conditioned Computer-Aided Design Generation with Transformer-Based Contrastive Representation and Diffusion Priorscited by 38
  18. 2024Img2CAD: Conditioned 3D CAD Model Generation from Single Image with Structured Visual Geometrycited by 37
  19. 2024Img2CAD: Reverse Engineering 3D CAD Models from Images through VLM-Assisted Conditional Factorizationcited by 35
  20. 2024Can Large Language Models Understand Symbolic Graphics Programs?cited by 35
  21. 2024Query2CAD: Generating CAD models using natural language queriescited by 29
  22. 2024TransCAD: A Hierarchical Transformer for CAD Sequence Inference from Point Cloudscited by 29
  23. 2024OpenECAD: An Efficient Visual Language Model for Editable 3D-CAD Designcited by 26
  24. 2025Seek-CAD: A Self-refined Generative Modeling for 3D Parametric CAD Using Local Inference via DeepSeekcited by 24
  25. 2022Neural Face Identification in a 2D Wireframe Projection of a Manifold Objectcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learning
  2. 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
  3. 2026CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generation
  4. 2026Text-to-CAD Retrieval: a Strong Baseline
  5. 2026BrepCoder: A Unified Multimodal Large Language Model for Multi-task B-rep Reasoning
  6. 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editing
  7. 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvement
  8. 2026PR-CAD: Progressive Refinement for Unified Controllable and Faithful Text-to-CAD Generation with Large Language Models