mlsanityData to 7 Oct 2026

Evaluating Gaussian Grasp Maps for Generative Grasping Models

arXiv 2206.00432 ↗First posted 1 Jun 2022cs.RO cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Generalising robotic grasping to previously unseen objects is a key task in general robotic manipulation. The current method for training many antipodal generative grasping models rely on a binary ground truth grasp map generated from the centre thirds of correctly labelled grasp rectangles. However, these binary maps do not accurately reflect the positions in which a robotic arm can correctly grasp a given object. We propose a continuous Gaussian representation of annotated grasps to generate ground truth training data which achieves a higher success rate on a simulated robotic grasping benchmark. Three modern generative grasping networks are trained with either binary or Gaussian grasp maps, along with recent advancements from the robotic grasping literature, such as discretisation of grasp angles into bins and an attentional loss function. Despite negligible difference according to the standard rectangle metric, Gaussian maps better reproduce the training data and therefore improve success rates when tested on the same simulated robot arm by avoiding collisions with the object: achieving 87.94% accuracy. Furthermore, the best performing model is shown to operate with a high success rate when transferred to a real robotic arm, at high inference speeds, without the need for transfer learning. The system is then shown to be capable of performing grasps on an antagonistic physical object dataset benchmark.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 29 references that are in the map. First posted on arXiv 1 Jun 2022.

Builds on

17 of 29 references.

References · 17

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 312
  4. 2018Sim-to-Real via Sim-to-Sim: Data-efficient Robotic Grasping via Randomized-to-Canonical Adaptation Networkscited by 171
  5. 2018Closing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approachcited by 117
  6. 2013Deep Learning for Detecting Robotic Graspscited by 114
  7. 2018Jacquard: A Large Scale Dataset for Robotic Grasp Detectioncited by 86
  8. 2014Real-Time Grasp Detection Using Convolutional Neural Networkscited by 75
  9. 2020EGAD! an Evolved Grasping Analysis Dataset for diversity and reproducibility in robotic manipulationcited by 61
  10. 2019Antipodal Robotic Grasping using Generative Residual Convolutional Neural Networkcited by 59
  11. 2016Robotic Grasp Detection using Deep Convolutional Neural Networkscited by 47
  12. 2016Depth Image Inpainting: Improving Low Rank Matrix Completion with Low Gradient Regularizationcited by 11
5 more
  1. 2019A Single Multi-Task Deep Neural Network with Post-Processing for Object Detection with Reasoning and Robotic Grasp Detectioncited by 8
  2. 2017Designing Deep Convolutional Neural Networks for Continuous Object Orientation Estimationcited by 6
  3. 2021Transferring Experience from Simulation to the Real World for Precise Pick-And-Place Tasks in Highly Cluttered Scenescited by 6
  4. 2020Orientation Attentive Robotic Grasp Synthesis with Augmented Grasp Map Representationcited by 3
  5. 2020Improving Robotic Grasping on Monocular Images Via Multi-Task Learning and Positional Losscited by 3

Built on by

Not cited yet.