Grasping Student: semi-supervised learning for robotic manipulation
Not on the map. Why?
Abstract (arXiv)
Gathering real-world data from the robot quickly becomes a bottleneck when constructing a robot learning system for grasping. In this work, we design a semi-supervised grasping system that, on top of a small sample of robot experience, takes advantage of images of products to be picked, which are collected without any interactions with the robot. We validate our findings both in the simulation and in the real world. In the regime of a small number of robot training samples, taking advantage of the unlabeled data allows us to achieve performance at the level of 10-fold bigger dataset size used by the baseline. The code and datasets used in the paper will be released at https://github.com/nomagiclab/grasping-student.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 42 references that are in the map. First posted on arXiv 8 Mar 2023.
Builds on
38 of 42 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
26 more
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,311
- 2017Hindsight Experience Replaycited by 1,136
- 2016Temporal Ensembling for Semi-Supervised Learningcited by 1,057
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2020CURL: Contrastive Unsupervised Representations for Reinforcement Learningcited by 760
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
- 2021FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labelingcited by 540
- 2017Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning resultscited by 472
- 2020Meta Pseudo Labelscited by 374
- 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 344
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 316
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 316
- 2017Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metricscited by 264
- 2021MT-Opt: Continuous Multi-Task Robotic Reinforcement Learning at Scalecited by 229
- 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 209
- 2018Learning Synergies between Pushing and Grasping with Self-supervised Deep Reinforcement Learningcited by 128
- 2017Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matchingcited by 125
- 2022Reinforcement Learning with Action-Free Pre-Training from Videoscited by 108
- 2018Jacquard: A Large Scale Dataset for Robotic Grasp Detectioncited by 87
- 2020ViNG: Learning Open-World Navigation with Visual Goalscited by 80
- 2021Learning to See before Learning to Act: Visual Pre-training for Manipulationcited by 51
- 2017Learning to Fly by Crashingcited by 41
- 2022Mask-based Latent Reconstruction for Reinforcement Learningcited by 39
- 2018Grasp2Vec: Learning Object Representations from Self-Supervised Graspingcited by 27
- 2022Light-weight probing of unsupervised representations for Reinforcement Learningcited by 15
Built on by
Not cited yet.