mlsanityData to 7 Oct 2026

Design-to-Plan: A Large Language Model-Based Multi-Agent Framework for Manufacturing Process Planning from 3D CAD Models and 2D Engineering Drawings

arXiv 2608.24039 ↗First posted 25 Aug 2026cs.RO cs.AIcited by 1

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Manufacturing process planning transforms heterogeneous design information into coherent manufacturing decisions. However, existing approaches focus on isolated subtasks, such as feature recognition, drawing interpretation, or tool selection, and struggle to support the full reasoning chain from design artifacts to process plans. This is critical when planning must interpret 3D CAD models, 2D engineering drawings, materials, and domain-specific rules. To address this gap, this paper presents Design-to-Plan, a large language model (LLM)-based multi-agent framework for end-to-end manufacturing process planning. An orchestrator coordinates specialized agents for 3D feature recognition, 2D drawing analysis, 2D-3D context fusion, knowledge retrieval, process sequencing, tool selection, and report generation. Rather than using LLMs as standalone text generators, the framework deploys them as reasoning agents that interact with deterministic modules and knowledge sources to produce consistent and traceable decisions. In this hybrid design, deterministic modules and specialized agents extract structured information from CAD and drawing inputs, while LLM agents perform context-aware reasoning, retrieve manufacturing rules, resolve conflicts, and generate planning outputs. The framework is evaluated using 300 benchmark cases across three downstream ReAct-enabled agents, plus separate evaluations of CAD feature recognition, drawing analysis, and 2D-3D context fusion. The parallel architecture achieves 100% success across downstream agents, Tool F1 scores of 95.9%-97.6%, 90% source detection accuracy in conflict analysis, and a 60%-68% reduction in token usage for key planning tasks. Results show that structured LLM-based multi-agent coordination can bridge design representations and manufacturing knowledge, enabling scalable, efficient, and traceable design-to-plan automation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 54 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

21 of 54 references.

References · 21

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  7. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  8. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  9. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  10. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
  11. 2022LayoutLMv3: Pre-training for Document AI with Unified Text and Image Maskingcited by 481
  12. 2024LLM-Based Multi-Agent Systems for Software Engineering: Literature Review, Vision and the Road Aheadcited by 155
9 more
  1. 2023DocLLM: A layout-aware generative language model for multimodal document understandingcited by 112
  2. 2021BRepNet: A topological message passing system for solid modelscited by 92
  3. 2023From Concept to Manufacturing: Evaluating Vision-Language Models for Engineering Designcited by 51
  4. 2023Towards autonomous system: flexible modular production system enhanced with large language model agentscited by 38
  5. 2024Large Language Models for Manufacturingcited by 24
  6. 2025Large Language Models for Computer-Aided Design: A Surveycited by 16
  7. 2025From Drawings to Decisions: A Hybrid Vision-Language Framework for Parsing 2D Engineering Drawings into Structured Manufacturing Knowledgecited by 8
  8. 2025A Multi-Stage Hybrid Framework for Automated Interpretation of Multi-View Engineering Drawings Using Vision Language Modelcited by 6
  9. 2024Automatic Feature Recognition and Dimensional Attributes Extraction From CAD Models for Hybrid Additive-Subtractive Manufacturingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Context-Aware Mapping of 2D Drawing Annotations to 3D CAD Features Using LLM-Assisted Reasoning for Manufacturing Automation
  2. 2026LLM-Aided Design for Manufacturing: A Multi-Agent System for Intent-Preserving Redesign of CAD for Improved Manufacturability
  3. 2025From Idea to CAD: A Language Model-Driven Multi-Agent System for Collaborative Design
  4. 2025A Multidisciplinary Design and Optimization (MDO) Agent Driven by Large Language Models
  5. 2025Knowledge Graph Fusion with Large Language Models for Accurate, Explainable Manufacturing Process Planning
  6. 2026AgentsCAD: Automated Design for Manufacturing of FDM Parts via Multi-Agent LLM Reasoning and Geometric Feature Recognition
  7. 2026ArtisanCAD: An Industrial-Level CAD Agent with Expert-Grounded Knowledge Distillation
  8. 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data