mlsanityData to 14 Oct 2026

AI-Powered Augmented Reality for Satellite Assembly, Integration and Test

arXiv 2409.18101 ↗First posted 26 Sep 2024cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The integration of Artificial Intelligence (AI) and Augmented Reality (AR) is set to transform satellite Assembly, Integration, and Testing (AIT) processes by enhancing precision, minimizing human error, and improving operational efficiency in cleanroom environments. This paper presents a technical description of the European Space Agency's (ESA) project "AI for AR in Satellite AIT," which combines real-time computer vision and AR systems to assist technicians during satellite assembly. Leveraging Microsoft HoloLens 2 as the AR interface, the system delivers context-aware instructions and real-time feedback, tackling the complexities of object recognition and 6D pose estimation in AIT workflows. All AI models demonstrated over 70% accuracy, with the detection model exceeding 95% accuracy, indicating a high level of performance and reliability. A key contribution of this work lies in the effective use of synthetic data for training AI models in AR applications, addressing the significant challenges of obtaining real-world datasets in highly dynamic satellite environments, as well as the creation of the Segmented Anything Model for Automatic Labelling (SAMAL), which facilitates the automatic annotation of real data, achieving speeds up to 20 times faster than manual human annotation. The findings demonstrate the efficacy of AI-driven AR systems in automating critical satellite assembly tasks, setting a foundation for future innovations in the space industry.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 33 references that are in the map. First posted on arXiv 26 Sep 2024.

Builds on

15 of 33 references.

References · 15

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  3. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
  4. 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
  5. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
  6. 2015An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognitioncited by 520
  7. 2016Synthetic Data for Text Localisation in Natural Imagescited by 396
  8. 2019DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusioncited by 355
  9. 2019Character Region Awareness for Text Detectioncited by 278
  10. 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
  11. 2014Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognitioncited by 214
  12. 2021GDRNPP: A Geometry-guided and Fully Learning-based Object Pose Estimatorcited by 148
3 more
  1. 2023BOP Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objectscited by 70
  2. 2021MMOCR: A Comprehensive Toolbox for Text Detection, Recognition and Understandingcited by 40
  3. 2020HoloLens 2 Research Mode as a Tool for Computer Vision Researchcited by 34

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025CAD2DMD-SET: Synthetic Generation Tool of Digital Measurement Device CAD Model Datasets for fine-tuning Large Vision-Language Modelscited by 1