mlsanityData to 7 Oct 2026

Egocentric Human-Object Interaction Detection Exploiting Synthetic Data

arXiv 2204.07061 ↗First posted 14 Apr 2022cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

We consider the problem of detecting Egocentric HumanObject Interactions (EHOIs) in industrial contexts. Since collecting and labeling large amounts of real images is challenging, we propose a pipeline and a tool to generate photo-realistic synthetic First Person Vision (FPV) images automatically labeled for EHOI detection in a specific industrial scenario. To tackle the problem of EHOI detection, we propose a method that detects the hands, the objects in the scene, and determines which objects are currently involved in an interaction. We compare the performance of our method with a set of state-of-the-art baselines. Results show that using a synthetic dataset improves the performance of an EHOI detection system, especially when few real data are available. To encourage research on this topic, we publicly release the proposed dataset at the following url: https://iplab.dmi.unict.it/EHOI_SYNTH/.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 28 of its 35 references that are in the map. First posted on arXiv 14 Apr 2022.

Builds on

28 of 35 references.

References · 28

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  4. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  5. 2017The Kinetics Human Action Video Datasetcited by 1,894
  6. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  7. 2020Rescaling Egocentric Visioncited by 529
  8. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  9. 2020Understanding Human Hands in Contact at Internet Scalecited by 281
  10. 2017Learning to Detect Human-Object Interactionscited by 238
  11. 2017First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotationscited by 229
  12. 2017Detecting and Recognizing Human-Object Interactionscited by 199
16 more
  1. 2015Visual Semantic Role Labelingcited by 188
  2. 2017GANerated Hands for Real-time 3D Hand Tracking from Monocular RGBcited by 147
  3. 2019PPDM: Parallel Point Detection and Matching for Real-time Human-Object Interaction Detectioncited by 143
  4. 2020Rolling-Unrolling LSTMs for Action Anticipation from First-Person Videocited by 119
  5. 2021Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformercited by 91
  6. 2017Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensorcited by 84
  7. 2020The MECCANO Dataset: Understanding Human-Object Interactions from Egocentric Videos in an Industrial-like Domaincited by 79
  8. 2019Holistic++ Scene Understanding: Single-view 3D Holistic Scene Parsing and Human Pose Estimation with Human-Object Interaction and Physical Commonsensecited by 71
  9. 2020In the Eye of the Beholder: Gaze and Actions in First Person Videocited by 68
  10. 2019Next-Active-Object prediction from Egocentric Videoscited by 55
  11. 2014The Evolution of First Person Vision Methods: A Surveycited by 19
  12. 2020Improved Handling of Motion Blur in Online Object Detectioncited by 18
  13. 2021Sequential Voting with Relational Box Fields for Active Object Detectioncited by 13
  14. 2021Understanding Egocentric Hand-Object Interactions from Hand Pose Estimationcited by 5
  15. 2019Egocentric Visitors Localization in Cultural Sitescited by 2
  16. 2021The Object at Hand: Automated Editing for Mixed Reality Video Guidance from Hand-Object Interactionscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 5; 2024: 0; 2025: 2; 2026: 3.

11 papers.

  1. 2023An Outlook into the Future of Egocentric Visioncited by 84
  2. 2023EgoObjects: A Large-Scale Egocentric Dataset for Fine-Grained Object Understandingcited by 39
  3. 2022PromptonomyViT: Multi-Task Prompt Learning Improves Video Transformers using Synthetic Scene Datacited by 14
  4. 2023Exploiting Multimodal Synthetic Data for Egocentric Human-Object Interaction Detection in an Industrial Scenariocited by 14
  5. 2023ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial Scenarioscited by 11
  6. 2023Are Synthetic Data Useful for Egocentric Hand-Object Interaction Detection?cited by 10
  7. 2025ANNEXE: Unified Analyzing, Answering, and Pixel Grounding for Egocentric Interactioncited by 5
  8. 2026EgoInteract: Synthetic Egocentric Videos Generation for Interaction Understanding and Anticipationcited by 1
  9. 2025Learning Egocentric In-Hand Object Segmentation through Weak Supervision from Human Narrationscited by 0
  10. 2026GlovEgo-HOI: Bridging the Synthetic-to-Real Gap for Industrial Egocentric Human-Object Interaction Detectioncited by 0
  11. 2026Leveraging Synthetic Data for Enhancing Egocentric Hand-Object Interaction Detectioncited by 0