Graspness Discovery in Clutters for Fast and Accurate Grasp Detection
Not on the map. Why?
Abstract (arXiv)
Efficient and robust grasp pose detection is vital for robotic manipulation. For general 6 DoF grasping, conventional methods treat all points in a scene equally and usually adopt uniform sampling to select grasp candidates. However, we discover that ignoring where to grasp greatly harms the speed and accuracy of current grasp pose detection methods. In this paper, we propose "graspness", a quality based on geometry cues that distinguishes graspable areas in cluttered scenes. A look-ahead searching method is proposed for measuring the graspness and statistical results justify the rationality of our method. To quickly detect graspness in practice, we develop a neural network named cascaded graspness model to approximate the searching process. Extensive experiments verify the stability, generality and effectiveness of our graspness model, allowing it to be used as a plug-and-play module for different methods. A large improvement in accuracy is witnessed for various previous methods after equipping our graspness model. Moreover, we develop GSNet, an end-to-end network that incorporates our graspness model for early filtering of low-quality predictions. Experiments on a large-scale benchmark, GraspNet-1Billion, show that our method outperforms previous arts by a large margin (30+ AP) and achieves a high inference speed. The library of GSNet has been integrated into AnyGrasp, which is at https://github.com/graspnet/anygrasp_sdk.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Builds on 29 of its 46 references that are in the map. First posted on arXiv 17 Jun 2024.
Builds on
29 of 46 references.
References · 29
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
- 2017Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metricscited by 259
- 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 237
- 2020Deep Global Registrationcited by 228
17 more
- 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 205
- 2018Closing the Loop for Robotic Grasping: A Real-time, Generative Grasp Synthesis Approachcited by 117
- 2013Deep Learning for Detecting Robotic Graspscited by 114
- 2017Grasp Pose Detection in Point Cloudscited by 107
- 2021Volumetric Grasping Network: Real-time 6 DOF Grasp Detection in Cluttercited by 94
- 2018PointNetGPD: Detecting Grasp Configurations from Point Setscited by 80
- 2020Learning multiview 3D point cloud registrationcited by 78
- 2014Real-Time Grasp Detection Using Convolutional Neural Networkscited by 75
- 2020Generative Sparse Detection Networks for 3D Single-shot Object Detectioncited by 69
- 2019S4G: Amodal Single-view Single-Shot SE(3) Grasp Detection in Cluttered Scenescited by 51
- 2016Robotic Grasp Detection using Deep Convolutional Neural Networkscited by 47
- 2016Analysis and Observations from the First Amazon Picking Challengecited by 41
- 2020PointNet++ Grasping: Learning An End-to-end Spatial Grasp Generation Algorithm from Sparse Point Cloudscited by 39
- 2021RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Imagescited by 38
- 2021SuctionNet-1Billion: A Large-Scale Benchmark for Suction Graspingcited by 32
- 2019A Billion Ways to Grasp: An Evaluation of Grasp Sampling Schemes on a Dense, Physics-based Grasp Data Setcited by 30
- 2018Densely Supervised Grasp Detector (DSGD)cited by 10
Built on by
Citing papers per year: 2024: 14; 2025: 21; 2026: 12.
47 papers.
Sort:
By area:
- 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulationcited by 55
- 2025SoFar: Language-Grounded Orientation Bridges Spatial Reasoning and Object Manipulationcited by 46
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 41
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 34
- 2024An Economic Framework for 6-DoF Grasp Detectioncited by 23
- 2025SuperDec: 3D Scene Decomposition with Superquadric Primitivescited by 19
- 2025AirExo-2: Scaling up Generalizable Robotic Imitation Learning with Low-Cost Exoskeletonscited by 17
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidancecited by 16
- 2025AnyDexGrasp: General Dexterous Grasping for Different Hands with Human-level Learning Efficiencycited by 14
- 2025ZeroGrasp: Zero-Shot Shape Reconstruction Enabled Robotic Graspingcited by 13
- 2026VLANeXt: Recipes for Building Strong VLA Modelscited by 12
- 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulationcited by 9
35 more
- 2024GAPartManip: A Large-scale Part-centric Dataset for Material-Agnostic Articulated Object Manipulationcited by 4
- 2025Task-Oriented 6-DoF Grasp Pose Detection in Clutterscited by 4
- 2024GraspMamba: A Mamba-based Language-driven Grasp Detection Framework with Hierarchical Feature Learningcited by 3
- 2024Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projectioncited by 2
- 2024LAC-Net: Linear-Fusion Attention-Guided Convolutional Network for Accurate Robotic Grasping Under the Occlusioncited by 2
- 2024Target-Oriented Object Grasping via Multimodal Human Guidancecited by 2
- 2024Measure Anything: Real-time, Multi-stage Vision-based Dimensional Measurement using Segment Anythingcited by 2
- 2024Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledgecited by 2
- 2025GraspCoT: Integrating Physical Property Reasoning for 6-DoF Grasping under Flexible Language Instructionscited by 2
- 2025Joint Flow Trajectory Optimization For Feasible Robot Motion Generation from Video Demonstrationscited by 2
- 2024Adapting Segment Anything Model for Unseen Object Instance Segmentationcited by 1
- 2024QuadWBG: Generalizable Quadrupedal Whole-Body Graspingcited by 1
- 2025Foundation Feature-Driven Online End-Effector Pose Estimation: A Marker-Free and Learning-Free Approachcited by 1
- 2025PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Graspcited by 1
- 2025Simultaneous Pick and Place Detection by Combining SE(3) Diffusion Models with Differential Kinematicscited by 1
- 2025Grasp the Graph (GtG) 2.0: Ensemble of Graph Neural Networks for High-Precision Grasp Pose Detection in Cluttercited by 1
- 2025SR3D: Unleashing Single-view 3D Reconstruction for Transparent and Specular Object Graspingcited by 1
- 2025MISCGrasp: Leveraging Multiple Integrated Scales and Contrastive Learning for Enhanced Volumetric Graspingcited by 1
- 2025A Segmented Robot Grasping Perception Neural Network for Edge AIcited by 1
- 2025Equivariant Volumetric Graspingcited by 1
- 2026LIEREx: Language-Image Embeddings for Robotic Explorationcited by 1
- 2026GarmentPile++: Affordance-Driven Cluttered Garments Retrieval with Vision-Language Reasoningcited by 1
- 2026RealVLG-R1: A Large-Scale Real-World Visual-Language Grounding Benchmark for Robotic Perception and Manipulationcited by 1
- 2026GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priorscited by 1
- 2025Watch Less, Feel More: Sim-to-Real RL for Generalizable Articulated Object Manipulation via Motion Adaptation and Impedance Controlcited by 0
- 2025Communication-Efficient Module-Wise Federated Learning for Grasp Pose Detection in Cluttered Environmentscited by 0
- 2025Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Maskcited by 0
- 2025SpikeGrasp: A Benchmark for 6-DoF Grasp Pose Detection from Stereo Spike Streamscited by 0
- 2026MultiGraspNet: A Multitask 3D Vision Model for Multi-gripper Robotic Graspingcited by 0
- 2026GraspLDP: Towards Generalizable Grasping Policy via Latent Diffusioncited by 0
- 2026RAAP: Retrieval-Augmented Affordance Prediction with Cross-Image Action Alignmentcited by 0
- 2026A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimationcited by 0
- 2026Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applicationscited by 0
- 2026GraRe: Grasp Candidate Re-Ranking for Frozen 6-DoF Grasp Detectorscited by 0
- 2026UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interactioncited by 0
- 2026UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction11 Sep 2026
- 2026GraRe: Grasp Candidate Re-Ranking for Frozen 6-DoF Grasp Detectors2 Aug 2026
- 2026Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applications18 Jun 2026
- 2026GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priors7 Jun 2026
- 2026A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimation5 Jun 2026
- 2026RAAP: Retrieval-Augmented Affordance Prediction with Cross-Image Action Alignment31 Mar 2026
- 2026RealVLG-R1: A Large-Scale Real-World Visual-Language Grounding Benchmark for Robotic Perception and Manipulation16 Mar 2026
- 2026GarmentPile++: Affordance-Driven Cluttered Garments Retrieval with Vision-Language Reasoning4 Mar 2026
- 2026GraspLDP: Towards Generalizable Grasping Policy via Latent Diffusion26 Feb 2026
- 2026VLANeXt: Recipes for Building Strong VLA Models20 Feb 2026
- 2026MultiGraspNet: A Multitask 3D Vision Model for Multi-gripper Robotic Grasping6 Feb 2026
- 2026LIEREx: Language-Image Embeddings for Robotic Exploration2 Feb 2026
35 more
- 2025SpikeGrasp: A Benchmark for 6-DoF Grasp Pose Detection from Stereo Spike Streams12 Oct 2025
- 2025Joint Flow Trajectory Optimization For Feasible Robot Motion Generation from Video Demonstrations25 Sep 2025
- 2025Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Mask4 Aug 2025
- 2025Equivariant Volumetric Grasping24 Jul 2025
- 2025A Segmented Robot Grasping Perception Neural Network for Edge AI18 Jul 2025
- 2025Communication-Efficient Module-Wise Federated Learning for Grasp Pose Detection in Cluttered Environments8 Jul 2025
- 2025MISCGrasp: Leveraging Multiple Integrated Scales and Contrastive Learning for Enhanced Volumetric Grasping3 Jul 2025
- 2025SR3D: Unleashing Single-view 3D Reconstruction for Transparent and Specular Object Grasping30 May 2025
- 2025Grasp the Graph (GtG) 2.0: Ensemble of Graph Neural Networks for High-Precision Grasp Pose Detection in Clutter5 May 2025
- 2025Simultaneous Pick and Place Detection by Combining SE(3) Diffusion Models with Differential Kinematics28 Apr 2025
- 2025PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Grasp22 Apr 2025
- 2025ZeroGrasp: Zero-Shot Shape Reconstruction Enabled Robotic Grasping15 Apr 2025
- 2025SuperDec: 3D Scene Decomposition with Superquadric Primitives1 Apr 2025
- 2025GraspCoT: Integrating Physical Property Reasoning for 6-DoF Grasping under Flexible Language Instructions20 Mar 2025
- 2025Foundation Feature-Driven Online End-Effector Pose Estimation: A Marker-Free and Learning-Free Approach18 Mar 2025
- 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulation12 Mar 2025
- 2025AirExo-2: Scaling up Generalizable Robotic Imitation Learning with Low-Cost Exoskeletons5 Mar 2025
- 2025Task-Oriented 6-DoF Grasp Pose Detection in Clutters24 Feb 2025
- 2025AnyDexGrasp: General Dexterous Grasping for Different Hands with Human-level Learning Efficiency23 Feb 2025
- 2025Watch Less, Feel More: Sim-to-Real RL for Generalizable Articulated Object Manipulation via Motion Adaptation and Impedance Control20 Feb 2025
- 2025SoFar: Language-Grounded Orientation Bridges Spatial Reasoning and Object Manipulation18 Feb 2025
- 2024Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge20 Dec 2024
- 2024Measure Anything: Real-time, Multi-stage Vision-based Dimensional Measurement using Segment Anything4 Dec 2024
- 2024GAPartManip: A Large-scale Part-centric Dataset for Material-Agnostic Articulated Object Manipulation27 Nov 2024
- 2024QuadWBG: Generalizable Quadrupedal Whole-Body Grasping11 Nov 2024
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenes30 Oct 2024
- 2024Adapting Segment Anything Model for Unseen Object Instance Segmentation23 Sep 2024
- 2024GraspMamba: A Mamba-based Language-driven Grasp Detection Framework with Hierarchical Feature Learning22 Sep 2024
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
- 2024Target-Oriented Object Grasping via Multimodal Human Guidance20 Aug 2024
- 2024LAC-Net: Linear-Fusion Attention-Guided Convolutional Network for Accurate Robotic Grasping Under the Occlusion6 Aug 2024
- 2024Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projection22 Jul 2024
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidance18 Jul 2024
- 2024An Economic Framework for 6-DoF Grasp Detection11 Jul 2024
- 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulation5 Jul 2024
- 2026VLANeXt: Recipes for Building Strong VLA Modelscited by 12
- 2026VLANeXt: Recipes for Building Strong VLA Models20 Feb 2026
- 2024RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulationcited by 55
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 41
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 34
- 2024An Economic Framework for 6-DoF Grasp Detectioncited by 23
- 2025SuperDec: 3D Scene Decomposition with Superquadric Primitivescited by 19
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidancecited by 16
- 2025AnyDexGrasp: General Dexterous Grasping for Different Hands with Human-level Learning Efficiencycited by 14
- 2025ZeroGrasp: Zero-Shot Shape Reconstruction Enabled Robotic Graspingcited by 13
- 2025GarmentPile: Point-Level Visual Affordance Guided Retrieval and Adaptation for Cluttered Garments Manipulationcited by 9
- 2024GAPartManip: A Large-scale Part-centric Dataset for Material-Agnostic Articulated Object Manipulationcited by 4
- 2025Task-Oriented 6-DoF Grasp Pose Detection in Clutterscited by 4
- 2024Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projectioncited by 2
12 most cited of 39 All 39 (JSON)
- 2026UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction11 Sep 2026
- 2026GraRe: Grasp Candidate Re-Ranking for Frozen 6-DoF Grasp Detectors2 Aug 2026
- 2026Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applications18 Jun 2026
- 2026GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priors7 Jun 2026
- 2026A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimation5 Jun 2026
- 2026RealVLG-R1: A Large-Scale Real-World Visual-Language Grounding Benchmark for Robotic Perception and Manipulation16 Mar 2026
- 2026GarmentPile++: Affordance-Driven Cluttered Garments Retrieval with Vision-Language Reasoning4 Mar 2026
- 2026MultiGraspNet: A Multitask 3D Vision Model for Multi-gripper Robotic Grasping6 Feb 2026
- 2026LIEREx: Language-Image Embeddings for Robotic Exploration2 Feb 2026
- 2025SpikeGrasp: A Benchmark for 6-DoF Grasp Pose Detection from Stereo Spike Streams12 Oct 2025
- 2025Joint Flow Trajectory Optimization For Feasible Robot Motion Generation from Video Demonstrations25 Sep 2025
- 2025Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Mask4 Aug 2025
12 newest of 39 All 39 (JSON)