mlsanityData to 14 Oct 2026

AI-based worker guidance in assembly and disassembly operations using multimodal ego/exo-centric data capture and structured task knowledge

arXiv 2608.22617 ↗First posted 23 Aug 2026cs.CV cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Assembly and disassembly processes rely on expert knowledge that is difficult to document, reuse, and transfer. This paper presents a data-centric approach for extracting structured task knowledge from expert demonstrations using egocentric and exocentric recordings. Temporal and multimodal information from video and narration is jointly encoded to derive structured task representations that enable procedural documentation and context-aware worker guidance. The approach is evaluated on a real-world disassembly case study, demonstrating that video-based representations capture procedural structure and execution context beyond static image-based methods. The results highlight the potential of egocentric video understanding for repair, training, and circular manufacturing applications. Project website: https://indego-assistant.github.io/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 22 references that are in the map. First posted on arXiv 23 Aug 2026.

Builds on

11 of 22 references.

References · 11

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  5. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 326
  6. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 287
  7. 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 208
  8. 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 176
  9. 2023An Outlook into the Future of Egocentric Visioncited by 84
  10. 2020Sim2Real Transfer for Reinforcement Learning without Dynamics Randomizationcited by 47
  11. 2025IndEgo: A Dataset of Industrial Scenarios and Collaborative Work for Egocentric Assistantscited by 10

Built on by

Not cited yet.