Learning suction graspability considering grasp quality and robot reachability for bin-picking
Not on the map. Why?
Abstract (arXiv)
Deep learning has been widely used for inferring robust grasps. Although human-labeled RGB-D datasets were initially used to learn grasp configurations, preparation of this kind of large dataset is expensive. To address this problem, images were generated by a physical simulator, and a physically inspired model (e.g., a contact model between a suction vacuum cup and object) was used as a grasp quality evaluation metric to annotate the synthesized images. However, this kind of contact model is complicated and requires parameter identification by experiments to ensure real world performance. In addition, previous studies have not considered manipulator reachability such as when a grasp configuration with high grasp quality is unable to reach the target due to collisions or the physical limitations of the robot. In this study, we propose an intuitive geometric analytic-based grasp quality evaluation metric. We further incorporate a reachability evaluation metric. We annotate the pixel-wise grasp quality and reachability by the proposed evaluation metric on synthesized images in a simulator to train an auto-encoder--decoder called suction graspability U-Net++ (SG-U-Net++). Experiment results show that our intuitive grasp quality evaluation metric is competitive with a physically-inspired metric. Learning the reachability helps to reduce motion planning computation time by removing obviously unreachable candidates. The system achieves an overall picking speed of 560 PPH (pieces per hour).
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 29 of its 73 references that are in the map. First posted on arXiv 4 Nov 2021.
Builds on
29 of 73 references.
References · 29
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 616
- 2018Deep Object Pose Estimation for Semantic Robotic Grasping of Household Objectscited by 237
- 2019TossingBot: Learning to Throw Arbitrary Objects with Residual Physicscited by 131
- 2017Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matchingcited by 124
- 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
- 2018Learning Synergies between Pushing and Grasping with Self-supervised Deep Reinforcement Learningcited by 121
- 2013Deep Learning for Detecting Robotic Graspscited by 114
- 2018Jacquard: A Large Scale Dataset for Robotic Grasp Detectioncited by 86
- 20196-DOF Grasping for Target-driven Object Manipulation in Cluttercited by 70
- 2019Antipodal Robotic Grasping using Generative Residual Convolutional Neural Networkcited by 59
- 2019SciPy 1.0--Fundamental Algorithms for Scientific Computing in Pythoncited by 49
17 more
- 2016Robotic Grasp Detection using Deep Convolutional Neural Networkscited by 47
- 2021SuctionNet-1Billion: A Large-Scale Benchmark for Suction Graspingcited by 32
- 2018ROI-based Robotic Grasp Detection for Object Overlapping Scenescited by 31
- 2019A Billion Ways to Grasp: An Evaluation of Grasp Sampling Schemes on a Dense, Physics-based Grasp Data Setcited by 30
- 2018Fully Convolutional Grasp Detection Network with Oriented Anchor Boxcited by 27
- 2018Multi-View Picking: Next-best-view Reaching for Improved Grasping in Cluttercited by 15
- 2021Dynamic Grasping with Reachability and Motion Awarenesscited by 15
- 2017A New Approach to Time-Optimal Path Parameterization based on Reachability Analysiscited by 12
- 2021Collision-Aware Target-Driven Object Grasping in Constrained Environmentscited by 11
- 2017Reuleaux: Robot Base Placement by Reachability Analysiscited by 10
- 2021GKNet: grasp keypoint network for grasp candidates detectioncited by 8
- 2019Learning to Generate 6-DoF Grasp Poses with Reachability Awarenesscited by 7
- 2021DefGraspSim: Simulation-based grasping of 3D deformable objectscited by 6
- 2018Workspace Aware Online Grasp Planningcited by 4
- 2019Minimal Work: A Grasp Quality Metric for Deformable Hollow Objectscited by 1
- 2021GI-NNet & RGI-NNet: Development of Robotic Grasp Pose Models, Trainable with Large as well as Limited Labelled Training Datasets, under supervised and semi supervised paradigmscited by 1
- 2021Deformation-Aware Data-Driven Grasp Synthesiscited by 1
Built on by
Citing papers per year: 2023: 3; 2024: 1; 2025: 1.
5 papers.
- 2023Sim-Suction: Learning a Suction Grasp Policy for Cluttered Environments Using a Synthetic Benchmarkcited by 7
- 2023Model-free Grasping with Multi-Suction Cup Grippers for Robotic Bin Pickingcited by 5
- 2024OptiGrasp: Optimized Grasp Pose Detection Using RGB Images for Warehouse Picking Robotscited by 2
- 2025Diffusion Suction Grasping with Large-Scale Parcel Datasetcited by 1
- 2023Sim-MEES: Modular End-Effector System Grasping Dataset for Mobile Manipulators in Cluttered Environmentscited by 0
- 2025Diffusion Suction Grasping with Large-Scale Parcel Dataset11 Feb 2025
- 2024OptiGrasp: Optimized Grasp Pose Detection Using RGB Images for Warehouse Picking Robots29 Sep 2024
- 2023Model-free Grasping with Multi-Suction Cup Grippers for Robotic Bin Picking31 Jul 2023
- 2023Sim-Suction: Learning a Suction Grasp Policy for Cluttered Environments Using a Synthetic Benchmark25 May 2023
- 2023Sim-MEES: Modular End-Effector System Grasping Dataset for Mobile Manipulators in Cluttered Environments17 May 2023