# AI Assisted AR Assembly: Object Recognition and Computer Vision for Augmented Reality Assisted Assembly

arXiv: https://arxiv.org/abs/2511.05394 · HTML: https://mlsanity.com/paper/2511.05394/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 4 of its 11 references that are in the map.
- First posted on arXiv 7 Nov 2025.

## Builds on (most cited first, 4 of 4)

- [Speech to Reality: On-Demand Production using Natural Language, 3D Generative AI, and Discrete Robotic Assembly](https://mlsanity.com/paper/2409.18390/) (2024)
- [Making Physical Objects with Generative AI and Robotic Assembly: Considering Fabrication Constraints, Sustainability, Time, Functionality, and Accessibility](https://mlsanity.com/paper/2504.19131/) (2025)
- [Gesture Recognition for Feedback Based Mixed Reality and Robotic Fabrication: A Case Study of the UnLog Tower](https://mlsanity.com/paper/2409.19281/) (2024)
- [Multi-3D-Models Registration-Based Augmented Reality (AR) Instructions for Assembly](https://mlsanity.com/paper/2311.16337/) (2023)

## Built on by (most cited first, 1 of 1)

- [Augmented Assembly: Object Recognition and Hand Tracking for Adaptive Assembly Instructions in Augmented Reality](https://mlsanity.com/paper/2601.11535/) (2025)

## Abstract (arXiv)

We present an AI-assisted Augmented Reality assembly workflow that uses deep learning-based object recognition to identify different assembly components and display step-by-step instructions. For each assembly step, the system displays a bounding box around the corresponding components in the physical space, and where the component should be placed. By connecting assembly instructions with the real-time location of relevant components, the system eliminates the need for manual searching, sorting, or labeling of different components before each assembly. To demonstrate the feasibility of using object recognition for AR-assisted assembly, we highlight a case study involving the assembly of LEGO sculptures.