mlsanityData to 14 Oct 2026

Development of a robust cascaded architecture for intelligent robot grasping using limited labelled data

arXiv 2112.03001 ↗First posted 6 Nov 2021cs.RO cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Grasping objects intelligently is a challenging task even for humans and we spend a considerable amount of time during our childhood to learn how to grasp objects correctly. In the case of robots, we can not afford to spend that much time on making it to learn how to grasp objects effectively. Therefore, in the present research we propose an efficient learning architecture based on VQVAE so that robots can be taught with sufficient data corresponding to correct grasping. However, getting sufficient labelled data is extremely difficult in the robot grasping domain. To help solve this problem, a semi-supervised learning based model which has much more generalization capability even with limited labelled data set, has been investigated. Its performance shows 6% improvement when compared with existing state-of-the-art models including our earlier model. During experimentation, It has been observed that our proposed model, RGGCNN2, performs significantly better, both in grasping isolated objects as well as objects in a cluttered environment, compared to the existing approaches which do not use unlabelled data for generating grasping rectangles. To the best of our knowledge, developing an intelligent robot grasping model (based on semi-supervised learning) trained through representation learning and exploiting the high-quality learning ability of GGCNN2 architecture with the limited number of labelled dataset together with the learned latent embeddings, can be used as a de-facto training method which has been established and also validated in this paper through rigorous hardware experimentations using Baxter (Anukul) research robot.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 49 references that are in the map. First posted on arXiv 6 Nov 2021.

Builds on

22 of 49 references.

References · 22

  1. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2013Auto-Encoding Variational Bayescited by 4,053
  4. 2015SSD: Single Shot MultiBox Detectorcited by 3,130
  5. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  6. 2014Show and Tell: A Neural Image Caption Generatorcited by 879
  7. 2016Conditional Image Generation with PixelCNN Decoderscited by 862
  8. 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 316
  9. 2017Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metricscited by 264
  10. 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 260
  11. 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 209
  12. 2017Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matchingcited by 125
10 more
  1. 2018Closing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approachcited by 120
  2. 2013Deep Learning for Detecting Robotic Graspscited by 116
  3. 2016SampleRNN: An Unconditional End-to-End Neural Audio Generation Modelcited by 110
  4. 2016Video Pixel Networkscited by 108
  5. 2013Data-Driven Grasp Synthesis - A Surveycited by 106
  6. 2018Jacquard: A Large Scale Dataset for Robotic Grasp Detectioncited by 87
  7. 2014Real-Time Grasp Detection Using Convolutional Neural Networkscited by 76
  8. 2016Robotic Grasp Detection using Deep Convolutional Neural Networkscited by 47
  9. 2017Learning a visuomotor controller for real world robotic grasping using simulated depth imagescited by 29
  10. 2017ORGB: Offset Correction in RGB Color Space for Illumination-Robust Image Processingcited by 1

Built on by

Not cited yet.