# Methodology to Deploy CNN-Based Computer Vision Models on Immersive Wearable Devices

arXiv: https://arxiv.org/abs/2407.00233 · HTML: https://mlsanity.com/paper/2407.00233/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 8 of its 19 references that are in the map.
- First posted on arXiv 28 Jun 2024.

## Builds on (most cited first, 8 of 8)

- [EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks](https://mlsanity.com/paper/1905.11946/) (2019)
- [MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications](https://mlsanity.com/paper/1704.04861/) (2017)
- [ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices](https://mlsanity.com/paper/1707.01083/) (2017)
- [Learning Transferable Architectures for Scalable Image Recognition](https://mlsanity.com/paper/1707.07012/) (2017)
- [SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size](https://mlsanity.com/paper/1602.07360/) (2016)
- [Deep Neural Network and Data Augmentation Methodology for off-axis iris segmentation in wearable headsets](https://mlsanity.com/paper/1903.00389/) (2019)
- [Artificial Intelligence Assisted Infrastructure Assessment Using Mixed Reality Systems](https://mlsanity.com/paper/1812.05659/) (2018)
- [Immersive Robot Programming Interface for Human-Guided Automation and Randomized Path Planning](https://mlsanity.com/paper/2406.02799/) (2024)

## Abstract (arXiv)

Convolutional Neural Network (CNN) models often lack the ability to incorporate human input, which can be addressed by Augmented Reality (AR) headsets. However, current AR headsets face limitations in processing power, which has prevented researchers from performing real-time, complex image recognition tasks using CNNs in AR headsets. This paper presents a method to deploy CNN models on AR headsets by training them on computers and transferring the optimized weight matrices to the headset. The approach transforms the image data and CNN layers into a one-dimensional format suitable for the AR platform. We demonstrate this method by training the LeNet-5 CNN model on the MNIST dataset using PyTorch and deploying it on a HoloLens AR headset. The results show that the model maintains an accuracy of approximately 98%, similar to its performance on a computer. This integration of CNN and AR enables real-time image processing on AR headsets, allowing for the incorporation of human input into AI models.