High precision grasp pose detection in dense clutter
Not on the map. Why?
Abstract (arXiv)
This paper considers the problem of grasp pose detection in point clouds. We follow a general algorithmic structure that first generates a large set of 6-DOF grasp candidates and then classifies each of them as a good or a bad grasp. Our focus in this paper is on improving the second step by using depth sensor scans from large online datasets to train a convolutional neural network. We propose two new representations of grasp candidates, and we quantify the effect of using prior knowledge of two forms: instance or category knowledge of the object to be grasped, and pretraining the network on simulated depth data obtained from idealized CAD models. Our analysis shows that a more informative grasp candidate representation as well as pretraining and prior knowledge significantly improve grasp detection. We evaluate our approach on a Baxter Research Robot and demonstrate an average grasp success rate of 93% in dense clutter. This is a 20% improvement compared to our prior work.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Mar 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 4; 2023: 4; 2024: 6; 2025: 5; 2026: 1.
33 papers.
Sort:
By area:
- 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 107
- 2021Scalable Scene Flow from Point Clouds in the Real Worldcited by 49
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splattingcited by 41
- 2021Long-Horizon Manipulation of Unknown Objects via Task and Motion Planning with Estimated Affordancescited by 38
- 2022Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detectioncited by 34
- 2024A3VLM: Actionable Articulation-Aware Vision Language Modelcited by 33
- 2021DDGC: Generative Deep Dexterous Grasping in Cluttercited by 28
- 2022Learning High-DOF Reaching-and-Grasping via Dynamic Representation of Gripper-Object Interactioncited by 23
- 2024An Economic Framework for 6-DoF Grasp Detectioncited by 23
- 2021Composing Pick-and-Place Tasks By Grounding Languagecited by 20
- 2024ICGNet: A Unified Approach for Instance-Centric Graspingcited by 16
- 2021Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimationcited by 14
21 more
- 2023Detect Everything with Few Examplescited by 13
- 2021Collision-Aware Target-Driven Object Grasping in Constrained Environmentscited by 11
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Cluttercited by 11
- 2021Simultaneous Multi-View Object Recognition and Grasping in Open-Ended Domainscited by 10
- 2021GKNet: grasp keypoint network for grasp candidates detectioncited by 8
- 2021Scene Editing as Teleoperation: A Case Study in 6DoF Kit Assemblycited by 6
- 2023Learning Any-View 6DoF Robotic Grasping in Cluttered Scenes via Neural Surface Renderingcited by 5
- 2021Visionary: Vision architecture discovery for robot learningcited by 4
- 2022GASCN: Graph Attention Shape Completion Networkcited by 3
- 2021Bootstrapping Motor Skill Learning with Motion Planningcited by 2
- 2024Bimanual Grasp Synthesis for Dexterous Robot Handscited by 2
- 2025Joint Flow Trajectory Optimization For Feasible Robot Motion Generation from Video Demonstrationscited by 2
- 2022Data-efficient learning of object-centric grasp preferencescited by 1
- 2023Integration of Vision-based Object Detection and Grasping for Articulated Manipulator in Lunar Conditionscited by 1
- 2025Language-Guided Object Search in Agricultural Environmentscited by 1
- 2025Grasp the Graph (GtG) 2.0: Ensemble of Graph Neural Networks for High-Precision Grasp Pose Detection in Cluttercited by 1
- 2023Sim-MEES: Modular End-Effector System Grasping Dataset for Mobile Manipulators in Cluttered Environmentscited by 0
- 2024Robust Loss Functions for Object Grasping under Limited Ground Truthcited by 0
- 2025Label-Efficient Grasp Joint Prediction with Point-JEPAcited by 0
- 2025ImaginationPolicy: Towards Generalizable, Precise and Reliable End-to-End Policy for Robotic Manipulationcited by 0
- 2026Language-Guided Grasping under Partial Observation for Mobile Manipulation in Field Inspection and Maintenancecited by 0
- 2026Language-Guided Grasping under Partial Observation for Mobile Manipulation in Field Inspection and Maintenance9 Mar 2026
- 2025ImaginationPolicy: Towards Generalizable, Precise and Reliable End-to-End Policy for Robotic Manipulation25 Sep 2025
- 2025Joint Flow Trajectory Optimization For Feasible Robot Motion Generation from Video Demonstrations25 Sep 2025
- 2025Label-Efficient Grasp Joint Prediction with Point-JEPA13 Sep 2025
- 2025Grasp the Graph (GtG) 2.0: Ensemble of Graph Neural Networks for High-Precision Grasp Pose Detection in Clutter5 May 2025
- 2025Language-Guided Object Search in Agricultural Environments3 Mar 2025
- 2024Bimanual Grasp Synthesis for Dexterous Robot Hands24 Nov 2024
- 2024Robust Loss Functions for Object Grasping under Limited Ground Truth9 Sep 2024
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splatting3 Sep 2024
- 2024An Economic Framework for 6-DoF Grasp Detection11 Jul 2024
- 2024A3VLM: Actionable Articulation-Aware Vision Language Model11 Jun 2024
- 2024ICGNet: A Unified Approach for Instance-Centric Grasping18 Jan 2024
21 more
- 2023Detect Everything with Few Examples22 Sep 2023
- 2023Integration of Vision-based Object Detection and Grasping for Articulated Manipulator in Lunar Conditions3 Sep 2023
- 2023Learning Any-View 6DoF Robotic Grasping in Cluttered Scenes via Neural Surface Rendering12 Jun 2023
- 2023Sim-MEES: Modular End-Effector System Grasping Dataset for Mobile Manipulators in Cluttered Environments17 May 2023
- 2022Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detection31 Oct 2022
- 2022Learning High-DOF Reaching-and-Grasping via Dynamic Representation of Gripper-Object Interaction3 Apr 2022
- 2022Data-efficient learning of object-centric grasp preferences1 Mar 2022
- 2022GASCN: Graph Attention Shape Completion Network20 Jan 2022
- 2021Scene Editing as Teleoperation: A Case Study in 6DoF Kit Assembly9 Oct 2021
- 2021Long-Horizon Manipulation of Unknown Objects via Task and Motion Planning with Estimated Affordances9 Aug 2021
- 2021Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimation5 Aug 2021
- 2021GKNet: grasp keypoint network for grasp candidates detection16 Jun 2021
- 2021Simultaneous Multi-View Object Recognition and Grasping in Open-Ended Domains3 Jun 2021
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Clutter29 Apr 2021
- 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations4 Apr 2021
- 2021Collision-Aware Target-Driven Object Grasping in Constrained Environments1 Apr 2021
- 2021Visionary: Vision architecture discovery for robot learning26 Mar 2021
- 2021DDGC: Generative Deep Dexterous Grasping in Clutter8 Mar 2021
- 2021Scalable Scene Flow from Point Clouds in the Real World1 Mar 2021
- 2021Composing Pick-and-Place Tasks By Grounding Language16 Feb 2021
- 2021Bootstrapping Motor Skill Learning with Motion Planning12 Jan 2021
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splattingcited by 41
- 2024A3VLM: Actionable Articulation-Aware Vision Language Modelcited by 33
- 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 107
- 2021Scalable Scene Flow from Point Clouds in the Real Worldcited by 49
- 2021Long-Horizon Manipulation of Unknown Objects via Task and Motion Planning with Estimated Affordancescited by 38
- 2022Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detectioncited by 34
- 2021DDGC: Generative Deep Dexterous Grasping in Cluttercited by 28
- 2022Learning High-DOF Reaching-and-Grasping via Dynamic Representation of Gripper-Object Interactioncited by 23
- 2024An Economic Framework for 6-DoF Grasp Detectioncited by 23
- 2021Composing Pick-and-Place Tasks By Grounding Languagecited by 20
- 2024ICGNet: A Unified Approach for Instance-Centric Graspingcited by 16
- 2021Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimationcited by 14
- 2023Detect Everything with Few Examplescited by 13
- 2021Collision-Aware Target-Driven Object Grasping in Constrained Environmentscited by 11
12 most cited of 31 All 31 (JSON)
- 2026Language-Guided Grasping under Partial Observation for Mobile Manipulation in Field Inspection and Maintenance9 Mar 2026
- 2025ImaginationPolicy: Towards Generalizable, Precise and Reliable End-to-End Policy for Robotic Manipulation25 Sep 2025
- 2025Joint Flow Trajectory Optimization For Feasible Robot Motion Generation from Video Demonstrations25 Sep 2025
- 2025Label-Efficient Grasp Joint Prediction with Point-JEPA13 Sep 2025
- 2025Grasp the Graph (GtG) 2.0: Ensemble of Graph Neural Networks for High-Precision Grasp Pose Detection in Clutter5 May 2025
- 2025Language-Guided Object Search in Agricultural Environments3 Mar 2025
- 2024Bimanual Grasp Synthesis for Dexterous Robot Hands24 Nov 2024
- 2024Robust Loss Functions for Object Grasping under Limited Ground Truth9 Sep 2024
- 2024An Economic Framework for 6-DoF Grasp Detection11 Jul 2024
- 2024ICGNet: A Unified Approach for Instance-Centric Grasping18 Jan 2024
- 2023Detect Everything with Few Examples22 Sep 2023
- 2023Integration of Vision-based Object Detection and Grasping for Articulated Manipulator in Lunar Conditions3 Sep 2023
12 newest of 31 All 31 (JSON)