mlsanityData to 14 Oct 2026

Text-to-CAD Retrieval: a Strong Baseline

arXiv 2605.05572 ↗First posted 7 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Text-based retrieval of Computer-Aided Design (CAD) models is a critical yet underexplored task for the reuse of legacy industrial designs. Existing CAD repositories are typically searched using filenames or directories, which limits the efficiency, scalability, and accuracy of design retrieval. In this paper, we formally introduce text-to-CAD retrieval as a new cross-modal retrieval task, aiming to retrieve semantically relevant CAD models from large-scale databases given natural language queries. Leveraging paired text-CAD annotations from the Text2CAD dataset, we establish a practical benchmark for this task. To achieve text-based retrieval, we propose a unified framework that learns multi-modal CAD embeddings from both procedural sequences and geometric point clouds. Specifically, a sequence encoder captures the construction logic of CAD models, while a point encoder extracts explicit geometric features. A text encoder is used to learn semantic representations of textual queries. During training, we introduce a novel feature decoder that reconstructs masked sequence features via cross-attention with text and point features, encouraging implicit multi-modal alignment. At inference time, we remove this auxiliary decoder to enable efficient retrieval using concatenated sequence-point features. Our framework serves as a strong baseline for text-to-CAD retrieval and lays the foundation for downstream CAD generation paradigms, such as retrieval-augmented generation. The source code will be released.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

34 of 43 references.

References · 34

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  5. 2023GPT-4 Technical Reportcited by 18,396
  6. 2024The Llama 3 Herd of Modelscited by 14,715
  7. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  8. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  9. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  10. 2017Neural Discrete Representation Learningcited by 4,712
  11. 2024Mixtral of Expertscited by 1,823
  12. 2020Point Transformercited by 1,470
22 more
  1. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
  2. 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 388
  3. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
  4. 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
  5. 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 125
  6. 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 103
  7. 2024Evaluating Retrieval Quality in Retrieval-Augmented Generationcited by 90
  8. 2023Hierarchical Neural Coding for Controllable CAD Model Generationcited by 86
  9. 2025CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generationcited by 67
  10. 2022ECLIPSE: Efficient Long-range Video Retrieval using Sight and Soundcited by 39
  11. 2024Img2CAD: Conditioned 3D CAD Model Generation from Single Image with Structured Visual Geometrycited by 37
  12. 2024FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Modelscited by 34
  13. 2018Y^2Seq2Seq: Cross-Modal Representation Learning for 3D Shape and Text by Joint Reconstruction and Prediction of View and Word Sequencescited by 27
  14. 2023Audio-Enhanced Text-to-Video Retrieval using Text-Conditioned Feature Alignmentcited by 21
  15. 2022TriCoLo: Trimodal Contrastive Loss for Text to Shape Retrievalcited by 18
  16. 2024Tri-Modal Motion Retrieval by Learning a Joint Embedding Spacecited by 16
  17. 2021Parts2Words: Learning Joint Embedding of Point Clouds and Texts by Bidirectional Matching between Parts and Wordscited by 14
  18. 2025SCA3D: Enhancing Cross-modal 3D Retrieval via 3D Shape and Caption Paired Data Augmentationcited by 9
  19. 2024Parametric Primitive Analysis of CAD Sketches with Vision Transformercited by 7
  20. 2025Revisiting CAD Model Generation by Learning Raster Sketchcited by 6
  21. 2025CMT: A Cascade MAR with Topology Predictor for Multimodal Conditional CAD Generationcited by 6
  22. 2025Enhanced Cross-modal 3D Retrieval via Tri-modal Reconstructioncited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026STEP-LLM: Generating CAD STEP Models from Natural Language with Large Language Models
  2. 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilities
  3. 2026UniCAD: A Unified Benchmark and Universal Model for Multi-Modal Multi-Task CAD
  4. 2026CADIR: A Cross-Backend Editable Intermediate Representation for Agentic CAD Generation
  5. 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editing
  6. 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models
  7. 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
  8. 2026BrepCoder: A Unified Multimodal Large Language Model for Multi-task B-rep Reasoning