End-to-End Autonomous Generation of Human Assembly Plans
New in Multimodal LLMs / vision-language models; no direction yet. Multimodal LLMs / vision-language models
Abstract (arXiv)
Turning a CAD design into an assembly plan is still largely done by hand, requiring engineers to reason about geometric feasibility, tool access, stability, and the ergonomics of human assembly. In this work, we encode long-established design for assembly (DfA) principles into a contained, end-to-end approach for generating assembly plans. Our approach takes only a mesh assembly and produces either a step-by-step assembly manual or a structured failure report, requiring no joint metadata, fastener annotations, or additional information. Four major components of a manufacturing plan are addressed autonomously: an assembly tool list, the assembly sequence and subassemblies, an assembly manual, and design feedback for improving assemblability. For determining the sequence plan, we systematically disassemble the object in a physics simulator and apply a cost function that encodes DfA principles. Manual generation, tool labelling, and assembly feedback rely primarily on multimodal large language models. Compared with a baseline that always removes the outermost part first from Tian et al., DfA-aware sequence planning reduces simulated assembly time, measured with a robot-arm assembly-time proxy, by 35% on 136 assemblies of 5 to 30 parts. The correct tool is selected for 88.6% of assembly steps. A vision-language model judge compares the generated manuals against ablated variants, identifying which page elements carry the information a reader needs. The presented approach and open-source code are available for use by engineers or AI agents looking to rapidly accelerate the creation of manufacturing plans for a given product design.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). First posted on arXiv 7 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Manual2Skill++: Connector-Aware General Robotic Assembly from Instruction Manuals via Vision-Language Models
- 2026WorkBenchMark: A LEGO-Based Assembly Benchmark with an Assembly-by-Disassembly Baseline for the Smart Manufacturing League
- 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generation
- 2026From Perception to Symbolic Task Planning: Vision-Language Guided Human-Robot Collaborative Structured Assembly
- 2024Blox-Net: Generative Design-for-Robot-Assembly Using VLM Supervision, Physics Simulation, and a Robot with Reset
- 2026Embodied CAD: Solver-Grounded LLM Agents for Parametric B-Rep Assembly Modeling
- 2026AssemState: Manual and Physical-State-Guided Reasoning for Zero-shot Furniture Assembly
- 2026FurnitureVLA: Learning Long-Horizon Bimanual Furniture Assembly with Vision-Language-Action Model