mlsanityData to 7 Oct 2026

GlovEgo-HOI: Bridging the Synthetic-to-Real Gap for Industrial Egocentric Human-Object Interaction Detection

arXiv 2601.09528 ↗First posted 14 Jan 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Egocentric Human-Object Interaction (EHOI) analysis is crucial for industrial safety, yet the development of robust models is hindered by the scarcity of annotated domain-specific data. We address this challenge by introducing a data generation framework that combines synthetic data with a diffusion-based process to augment real-world images with realistic Personal Protective Equipment (PPE). We present GlovEgo-HOI, a new benchmark dataset for industrial EHOI, and GlovEgo-Net, a model integrating Glove-Head and Keypoint- Head modules to leverage hand pose information for enhanced interaction detection. Extensive experiments demonstrate the effectiveness of the proposed data generation framework and GlovEgo-Net. To foster further research, we release the GlovEgo-HOI dataset, augmentation pipeline, and pre-trained models at: GitHub project.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 28 references that are in the map. First posted on arXiv 14 Jan 2026.

Builds on

24 of 28 references.

References · 24

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  3. 2017Mask R-CNNcited by 7,259
  4. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  5. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  6. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
  7. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
  8. 2020Rescaling Egocentric Visioncited by 529
  9. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  10. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
  11. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
  12. 2020Understanding Human Hands in Contact at Internet Scalecited by 281
12 more
  1. 2020MediaPipe Hands: On-device Real-time Hand Trackingcited by 157
  2. 2022EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relationscited by 139
  3. 2023Affordance Diffusion: Synthesizing Hand-Object Interactionscited by 110
  4. 2020The MECCANO Dataset: Understanding Human-Object Interactions from Egocentric Videos in an Industrial-like Domaincited by 79
  5. 2022Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applicationscited by 78
  6. 2020In the Eye of the Beholder: Gaze and Actions in First Person Videocited by 68
  7. 2023IndustReal: A Dataset for Procedure Step Recognition Handling Execution Errors in Egocentric Videos in an Industrial-Like Settingcited by 46
  8. 2022MECCANO: A Multimodal Egocentric Dataset for Humans Behavior Understanding in the Industrial-like Domaincited by 36
  9. 2023Exploiting Multimodal Synthetic Data for Egocentric Human-Object Interaction Detection in an Industrial Scenariocited by 14
  10. 2021Sequential Voting with Relational Box Fields for Active Object Detectioncited by 13
  11. 2022Egocentric Human-Object Interaction Detection Exploiting Synthetic Datacited by 11
  12. 2021Egocentric Hand-object Interaction Detection and Applicationcited by 7

Built on by

Not cited yet.