mlsanityData to 14 Oct 2026

BRepCLIP: Contrastive Multimodal Pretraining on BRep Primitives for CAD Understanding

arXiv 2606.05515 ↗First posted 3 Jun 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Learning representations of CAD models is a largely open problem. While 3D representation learning has flourished around point clouds and meshes, the native format of CAD - boundary representations BReps, which encodes exact parametric surfaces, curves, and their topology, has received little attention as a representation learning substrate. We introduce BRepCLIP, the first framework to align BRep geometry with language and image embeddings through contrastive pretraining. We model each CAD object as a sequence of face and edge tokens with separate discrete vocabularies for surface and curve geometry, augmented with spatial and semantic descriptors that capture surface types (e.g., cylindrical, torus, NURBS) and curve primitives (e.g., line, arc, B-spline). A transformer encoder aggregates these tokens into a global BRep embedding, aligned with CLIP's text and image encoders via a joint contrastive objective. BRepCLIP generates more discriminative and semantically grounded embeddings than existing point-based alternatives, improving Top-1 retrieval over OpenShape by 40.4%, 22.0%, and 23.9% on ABC, CADParser, and Automate, respectively, and improving zero-shot classification on FabWave by 15% in Top-1 score. We further demonstrate its utility as a CAD-aware similarity metric for evaluating text and image-conditioned CAD generation, establishing the importance of structure-aware pretraining for multimodal CAD understanding. Project page is available at https://muhammadusama100.github.io/BrepClip2026/

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 44 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

31 of 44 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  3. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  4. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
  5. 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 379
  6. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
  7. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
  8. 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 202
  9. 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 184
  10. 2018Scan2CAD: Learning CAD Model Alignment in RGB-D Scanscited by 142
  11. 2021BRepNet: A topological message passing system for solid modelscited by 95
  12. 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 81
19 more
  1. 2025CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generationcited by 67
  2. 2024CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attentioncited by 64
  3. 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 53
  4. 2025Text-to-CAD Generation Through Infusing Visual Feedback in Large Language Modelscited by 47
  5. 2023Point2CAD: Reverse Engineering CAD Models from 3D Point Cloudscited by 36
  6. 2022Self-Supervised Representation Learning for CADcited by 22
  7. 2023SHARP Challenge 2023: Solving CAD History and pArameters Recovery from Point clouds and 3D scans. Overview, Datasets, Metrics, and Baselinescited by 19
  8. 2023Sculpting Holistic 3D Representation in Contrastive Language-Image-3D Pre-trainingcited by 18
  9. 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learningcited by 16
  10. 2024Geometric Deep Learning for Computer-Aided Design: A Surveycited by 14
  11. 2025Bringing Attention to CAD: Boundary Representation Learning via Transformercited by 9
  12. 2024FastCAD: Real-Time CAD Retrieval and Alignment from Scans and Videoscited by 7
  13. 2024MARVEL-40M+: Multi-Level Visual Elaboration for High-Fidelity Text-to-3D Content Creationcited by 7
  14. 2025NURBGen: High-Fidelity Text-to-CAD Generation through LLM-Driven NURBS Modelingcited by 6
  15. 2024BRep Boundary and Junction Detection for CAD Reverse Engineeringcited by 4
  16. 2025CADReview: Automatically Reviewing CAD Programs with Error Detection and Correctioncited by 4
  17. 2026BrepCoder: A Unified Multimodal Large Language Model for Multi-task B-rep Reasoningcited by 3
  18. 2026OSCAR: Open-Set CAD Retrieval from a Language Prompt and a Single Imagecited by 2
  19. 2026DreamCAD: Scaling Multi-modal CAD Generation using Differentiable Parametric Surfacescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.