Collision-Aware Target-Driven Object Grasping in Constrained Environments
Not on the map. Why?
Abstract (arXiv)
Grasping a novel target object in constrained environments (e.g., walls, bins, and shelves) requires intensive reasoning about grasp pose reachability to avoid collisions with the surrounding structures. Typical 6-DoF robotic grasping systems rely on the prior knowledge about the environment and intensive planning computation, which is ungeneralizable and inefficient. In contrast, we propose a novel Collision-Aware Reachability Predictor (CARP) for 6-DoF grasping systems. The CARP learns to estimate the collision-free probabilities for grasp poses and significantly improves grasping in challenging environments. The deep neural networks in our approach are trained fully by self-supervision in simulation. The experiments in both simulation and the real world show that our approach achieves more than 75% grasping rate on novel objects in various surrounding structures. The ablation study demonstrates the effectiveness of the CARP, which improves the 6-DoF grasping rate by 95.7%.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 1 Apr 2021.
Builds on
23 of 38 references.
References · 23
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2016Semantic Scene Completion from a Single Depth Imagecited by 468
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 312
- 2017Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metricscited by 259
- 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 237
- 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 208
- 2018Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experiencecited by 203
- 2017Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Graspingcited by 138
- 2018Learning Synergies between Pushing and Grasping with Self-supervised Deep Reinforcement Learningcited by 121
- 2013Deep Learning for Detecting Robotic Graspscited by 114
- 2017Grasp Pose Detection in Point Cloudscited by 107
11 more
- 2013Data-Driven Grasp Synthesis - A Surveycited by 104
- 2019Grasping in the Wild:Learning 6DoF Closed-Loop Grasping from Low-Cost Demonstrationscited by 104
- 20196-DOF Grasping for Target-driven Object Manipulation in Cluttercited by 70
- 2018Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervisioncited by 50
- 2017Multi-Task Domain Adaptation for Deep Learning of Instance Grasping from Simulationcited by 35
- 2016High precision grasp pose detection in dense cluttercited by 33
- 2019Mechanical Search: Multi-Step Retrieval of a Target Object Occluded by Cluttercited by 30
- 2019A Deep Learning Approach to Grasping the Invisiblecited by 18
- 2019Learning to Generate 6-DoF Grasp Poses with Reachability Awarenesscited by 7
- 2018Workspace Aware Online Grasp Planningcited by 4
- 2019Learning Visual Affordances with Target-Orientated Deep Q-Network to Grasp Objects by Harnessing Environmental Fixturescited by 3
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 2; 2024: 2.
11 papers.
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 125
- 2024ICGNet: A Unified Approach for Instance-Centric Graspingcited by 16
- 2022Keypoint-GraspNet: Keypoint-based 6-DoF Grasp Generation from the Monocular RGB-D inputcited by 10
- 2022Where To Start? Transferring Simple Skills to Complex Environmentscited by 9
- 2022Cluttered Food Grasping with Adaptive Fingers and Synthetic-Data Trained Object Detectioncited by 8
- 2021Learning suction graspability considering grasp quality and robot reachability for bin-pickingcited by 5
- 2022Multi-Object Grasping in the Planecited by 5
- 2022Learning to Efficiently Plan Robust Frictional Multi-Object Graspscited by 5
- 2023Graph learning in robotics: a surveycited by 5
- 2023KGNv2: Separating Scale and Pose Prediction for Keypoint-based 6-DoF Grasp Synthesis on RGB-D inputcited by 4
- 2024Target-Oriented Object Grasping via Multimodal Human Guidancecited by 2
- 2024Target-Oriented Object Grasping via Multimodal Human Guidance20 Aug 2024
- 2024ICGNet: A Unified Approach for Instance-Centric Grasping18 Jan 2024
- 2023Graph learning in robotics: a survey6 Oct 2023
- 2023KGNv2: Separating Scale and Pose Prediction for Keypoint-based 6-DoF Grasp Synthesis on RGB-D input9 Mar 2023
- 2022Where To Start? Transferring Simple Skills to Complex Environments12 Dec 2022
- 2022Learning to Efficiently Plan Robust Frictional Multi-Object Grasps13 Oct 2022
- 2022Keypoint-GraspNet: Keypoint-based 6-DoF Grasp Generation from the Monocular RGB-D input19 Sep 2022
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusion8 Sep 2022
- 2022Multi-Object Grasping in the Plane1 Jun 2022
- 2022Cluttered Food Grasping with Adaptive Fingers and Synthetic-Data Trained Object Detection10 Mar 2022
- 2021Learning suction graspability considering grasp quality and robot reachability for bin-picking4 Nov 2021