mlsanityData to 14 Oct 2026

Comparison of synthetic dataset generation methods for medical intervention rooms using medical clothing detection as an example

arXiv 2209.11493 ↗First posted 23 Sep 2022cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

The availability of real data from areas with high privacy requirements, such as the medical intervention space, is low and the acquisition legally complex. Therefore, this work presents a way to create a synthetic dataset for the medical context, using medical clothing as an example. The goal is to close the reality gap between the synthetic and real data. For this purpose, methods of 3D-scanned clothing and designed clothing are compared in a Domain-Randomization and Structured-Domain-Randomization scenario using an Unreal-Engine plugin or Unity. Additionally a Mixed-Reality dataset in front of a greenscreen and a target domain dataset were used. Our experiments show, that Structured-Domain-Randomization of designed clothing together with Mixed-Reality data provide a baseline achieving 72.0% mAP on a test dataset of the clinical target domain. When additionally using 15% of available target domain train data, the gap towards 100% (660 images) target domain train data could be nearly closed 80.05% mAP (81.95% mAP). Finally we show that when additionally using 100% target domain train data the accuracy could be increased to 83.35% mAP.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 35 references that are in the map. First posted on arXiv 23 Sep 2022.

Builds on

20 of 35 references.

References · 20

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
  5. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  6. 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
  7. 2017Focal Loss for Dense Object Detectioncited by 752
  8. 2017Learning from Synthetic Humanscited by 359
  9. 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 294
  10. 2018Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objectscited by 241
  11. 2016CAD2RL: Real Single-Image Flight without a Single Real Imagecited by 233
  12. 2020Scaled-YOLOv4: Scaling Cross Stage Partial Networkcited by 211
8 more
  1. 2020STAR: Sparse Trained Articulated Human Body Regressorcited by 194
  2. 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 181
  3. 2018Structured Domain Randomization: Bridging the Reality Gap by Context-Aware Synthetic Datacited by 94
  4. 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
  5. 2017Transferring End-to-End Visuomotor Control from Simulation to Real World for a Multi-Stage Taskcited by 66
  6. 2018MVOR: A Multi-view RGB-D Operating Room Dataset for 2D and 3D Human Pose Estimationcited by 49
  7. 2021Unity Perception: Generate Synthetic Data for Computer Visioncited by 43
  8. 2020Automatic Operating Room Surgical Activity Recognition for Robot-Assisted Surgerycited by 34

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.