Context-Aware Mapping of 2D Drawing Annotations to 3D CAD Features Using LLM-Assisted Reasoning for Manufacturing Automation
Not on the map. Why?
Abstract (arXiv)
Manufacturing automation in process planning, inspection planning, and digital-thread integration depends on a unified specification that binds the geometric features of a 3D CAD model to the geometric dimensioning and tolerancing (GD&T) callouts, datum definitions, and surface requirements carried by the corresponding 2D engineering drawing. Although Model-Based Definition (MBD) allows such specifications to be embedded directly in 3D models, 2D drawings remain the primary carrier of manufacturing intent in automotive, aerospace, shipbuilding, and heavy-machinery industries. Correctly linking drawing annotations to the corresponding 3D features is difficult because of contextual ambiguity, repeated feature patterns, and the need for transparent and traceable decisions. This paper presents a deterministic-first, context-aware framework that maps 2D drawing entities to 3D CAD features to produce a unified manufacturing specification. Drawing callouts are first semantically enriched and then scored against candidate features using an interpretable metric that combines type compatibility, tolerance-aware dimensional agreement, and conservative context consistency, along with engineering-domain heuristics. When deterministic scoring cannot resolve an ambiguity, the system escalates to multimodal and constrained large-language-model reasoning, followed by a single human-in-the-loop (HITL) review step. Experiments on 20 real CAD-drawing pairs achieve a mean precision of 83.67%, recall of 90.46%, and F1 score of 86.29%. An ablation study shows that each pipeline component contributes to overall accuracy, with the full system outperforming all reduced variants. By prioritizing deterministic rules, clear decision tracking, and retaining unresolved cases for human review, the framework provides a practical foundation for downstream manufacturing automation in real-world industrial environments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 5 of its 15 references that are in the map. First posted on arXiv 20 Feb 2026.
Builds on
5 of 15 references.
References · 5
- 2023From Concept to Manufacturing: Evaluating Vision-Language Models for Engineering Designcited by 51
- 2024Fine-Tuning Vision-Language Model for Automated Engineering Drawing Information Extractioncited by 18
- 2025From Drawings to Decisions: A Hybrid Vision-Language Framework for Parsing 2D Engineering Drawings into Structured Manufacturing Knowledgecited by 8
- 2025A Multi-Stage Hybrid Framework for Automated Interpretation of Multi-View Engineering Drawings Using Vision Language Modelcited by 6
- 2025Automated Parsing of Engineering Drawings for Structured Information Extraction Using a Fine-tuned Document Understanding Transformercited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Design-to-Plan: A Large Language Model-Based Multi-Agent Framework for Manufacturing Process Planning from 3D CAD Models and 2D Engineering Drawings
- 2025PHT-CAD: Efficient CAD Parametric Primitive Analysis with Progressive Hierarchical Tuning
- 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction
- 2024Leveraging Vision-Language Models for Manufacturing Feature Recognition in CAD Designs
- 2026MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generation
- 2026Vision2CAD: A Visual Agent Harness for Explicit Geometry Referencing and Localization in Parametric CAD Modeling
- 2024From 2D CAD Drawings to 3D Parametric Models: A Vision-Language Approach