Improving Data Efficiency of Self-supervised Learning for Robotic Grasping
Not on the map. Why?
Abstract (arXiv)
Given the task of learning robotic grasping solely based on a depth camera input and gripper force feedback, we derive a learning algorithm from an applied point of view to significantly reduce the amount of required training data. Major improvements in time and data efficiency are achieved by: Firstly, we exploit the geometric consistency between the undistorted depth images and the task space. Using a relative small, fully-convolutional neural network, we predict grasp and gripper parameters with great advantages in training as well as inference performance. Secondly, motivated by the small random grasp success rate of around 3%, the grasp space was explored in a systematic manner. The final system was learned with 23000 grasp attempts in around 60h, improving current solutions by an order of magnitude. For typical bin picking scenarios, we measured a grasp success rate of 96.6%. Further experiments showed that the system is able to generalize and transfer knowledge to novel objects and environments.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 0; 2023: 2; 2024: 2.
6 papers.
- 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunkingcited by 169
- 2024Semantically Controllable Augmentations for Generalizable Robot Learningcited by 18
- 2023Agent as Cerebrum, Controller as Cerebellum: Implementing an Embodied LMM-based Agent on Dronescited by 9
- 2021Transferring Experience from Simulation to the Real World for Precise Pick-And-Place Tasks in Highly Cluttered Scenescited by 6
- 2021Visionary: Vision architecture discovery for robot learningcited by 4
- 2024Good Grasps Only: A data engine for self-supervised fine-tuning of pose estimation using grasp poses for verificationcited by 2
- 2024Good Grasps Only: A data engine for self-supervised fine-tuning of pose estimation using grasp poses for verification17 Sep 2024
- 2024Semantically Controllable Augmentations for Generalizable Robot Learning2 Sep 2024
- 2023Agent as Cerebrum, Controller as Cerebellum: Implementing an Embodied LMM-based Agent on Drones25 Nov 2023
- 2023RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunking5 Sep 2023
- 2021Visionary: Vision architecture discovery for robot learning26 Mar 2021
- 2021Transferring Experience from Simulation to the Real World for Precise Pick-And-Place Tasks in Highly Cluttered Scenes12 Jan 2021