A mixed-reality dataset for category-level 6D pose and size estimation of hand-occluded containers
Not on the map. Why?
Abstract (arXiv)
Estimating the 6D pose and size of household containers is challenging due to large intra-class variations in the object properties, such as shape, size, appearance, and transparency. The task is made more difficult when these objects are held and manipulated by a person due to varying degrees of hand occlusions caused by the type of grasps and by the viewpoint of the camera observing the person holding the object. In this paper, we present a mixed-reality dataset of hand-occluded containers for category-level 6D object pose and size estimation. The dataset consists of 138,240 images of rendered hands and forearms holding 48 synthetic objects, split into 3 grasp categories over 30 real backgrounds. We re-train and test an existing model for 6D object pose estimation on our mixed-reality dataset. We discuss the impact of the use of this dataset in improving the task of 6D pose and size estimation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 18 Nov 2022.
Builds on
20 of 33 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2017Mask R-CNNcited by 7,277
- 2015Fast R-CNNcited by 2,933
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2020Rescaling Egocentric Visioncited by 540
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2019Learning joint reconstruction of hands and manipulated objectscited by 378
- 2020CosyPose: Consistent multi-view multi-object 6D pose estimationcited by 287
- 2018BOP: Benchmark for 6D Object Pose Estimationcited by 254
- 2018Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objectscited by 241
- 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
8 more
- 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 181
- 2020Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotationscited by 155
- 2019HomebrewedDB: RGB-D Dataset for 6D Pose Estimation of 3D Objectscited by 110
- 2019KeyPose: Multi-View 3D Labeling and Keypoint Estimation for Transparent Objectscited by 75
- 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimizationcited by 72
- 2020Object Handovers: a Review for Roboticscited by 28
- 2021The CORSMAL benchmark for the prediction of the properties of containerscited by 6
- 2022Audio-Visual Object Classification for Human-Robot Collaborationcited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 2.
3 papers.