Robotic Grasp Detection using Deep Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
Deep learning has significantly advanced computer vision and natural language processing. While there have been some successes in robotics using deep learning, it has not been widely adopted. In this paper, we present a novel robotic grasp detection system that predicts the best grasping pose of a parallel-plate robotic gripper for novel objects using the RGB-D image of the scene. The proposed model uses a deep convolutional neural network to extract features from the scene and then uses a shallow convolutional neural network to predict the grasp configuration for the object of interest. Our multi-modal model achieved an accuracy of 89.21% on the standard Cornell Grasp Dataset and runs at real-time speeds. This redefines the state-of-the-art for robotic grasp detection.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 14; 2023: 10; 2024: 6; 2025: 4.
47 papers.
Sort:
By area:
- 2023Open-World Object Manipulation using Pre-trained Vision-Language Modelscited by 155
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 47
- 2021RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Imagescited by 38
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 34
- 2022MonoGraspNet: 6-DoF Grasping with a Single RGB Imagecited by 24
- 2021A Joint Network for Grasp Detection Conditioned on Natural Language Commandscited by 23
- 2023Open-sourced Data Ecosystem in Autonomous Driving: the Present and Futurecited by 22
- 2021Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimationcited by 14
- 2023Exploring Visual Pre-training for Robot Manipulation: Datasets, Models and Methodscited by 14
- 2022When Transformer Meets Robotic Grasping: Exploits Context for Efficient Grasp Detectioncited by 12
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Cluttercited by 11
- 2022DA2 Dataset: Toward Dexterity-Aware Dual-Arm Graspingcited by 10
35 more
- 2023RGB-D Grasp Detection via Depth Guided Learning with Cross-modal Attentioncited by 9
- 2024Lightweight Language-driven Grasp Detection using Conditional Consistency Modelcited by 9
- 2021GKNet: grasp keypoint network for grasp candidates detectioncited by 8
- 2021A Hybrid Approach for Learning to Shift and Grasp with Elaborate Motion Primitivescited by 6
- 2022Environment Optimization for Multi-Agent Navigationcited by 6
- 2023Constrained Environment Optimization for Prioritized Multi-Agent Navigationcited by 6
- 2021Learning suction graspability considering grasp quality and robot reachability for bin-pickingcited by 5
- 2022I Know What You Draw: Learning Grasp Detection Conditioned on a Few Freehand Sketchescited by 4
- 2022Hybrid Physical Metric For 6-DoF Grasp Pose Detectioncited by 4
- 2023GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenescited by 4
- 2021Depth-aware Object Segmentation and Grasp Detection for Robotic Picking Taskscited by 3
- 2022Open Arms: Open-Source Arms, Hands & Controlcited by 3
- 2023NBMOD: Find It and Grasp It in Noisy Backgroundcited by 3
- 2024Improving the Successful Robotic Grasp Detection Using Convolutional Neural Networkscited by 3
- 2021Double-Dot Network for Antipodal Grasp Detectioncited by 2
- 2022A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutionscited by 2
- 2023MotorFactory: A Blender Add-on for Large Dataset Generation of Small Electric Motorscited by 2
- 2024HMT-Grasp: A Hybrid Mamba-Transformer Approach for Robot Grasping in Cluttered Environmentscited by 2
- 2025VCoT-Grasp: Grasp Foundation Models with Visual Chain-of-Thought Reasoning for Language-driven Grasp Generationcited by 2
- 2021Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detectioncited by 1
- 2021GI-NNet & RGI-NNet: Development of Robotic Grasp Pose Models, Trainable with Large as well as Limited Labelled Training Datasets, under supervised and semi supervised paradigmscited by 1
- 2023Reinforcement Learning for Picking Cluttered General Objects with Dense Object Descriptorscited by 1
- 2023FViT-Grasp: Grasping Objects With Using Fast Vision Transformerscited by 1
- 2024Simple In-place Data Augmentation for Surveillance Object Detectioncited by 1
- 2025Visual Affordance Prediction: Survey and Reproducibilitycited by 1
- 2025Language-Guided Grasp Detection with Coarse-to-Fine Learning for Robotic Manipulationcited by 1
- 2021Real-World Semantic Grasp Detection Based on Attention Mechanismcited by 0
- 2021Development of a robust cascaded architecture for intelligent robot grasping using limited labelled datacited by 0
- 2022PEGG-Net: Pixel-Wise Efficient Grasp Generation in Complex Scenescited by 0
- 2022DcnnGrasp: Towards Accurate Grasp Pattern Recognition with Adaptive Regularizer Learningcited by 0
- 2022Evaluating Gaussian Grasp Maps for Generative Grasping Modelscited by 0
- 2022A Secure and Efficient Multi-Object Grasping Detection Approach for Robotic Armscited by 0
- 2022Top-Tuning: a study on transfer learning for an efficient alternative to fine tuning for image classification with fast kernel methodscited by 0
- 2022MMRNet: Improving Reliability for Multimodal Object Detection and Segmentation for Bin Picking via Multimodal Redundancycited by 0
- 2025XGrasp: Gripper-Aware Grasp Detection with Multi-Gripper Data Generationcited by 0
- 2025Language-Guided Grasp Detection with Coarse-to-Fine Learning for Robotic Manipulation24 Dec 2025
- 2025XGrasp: Gripper-Aware Grasp Detection with Multi-Gripper Data Generation13 Oct 2025
- 2025VCoT-Grasp: Grasp Foundation Models with Visual Chain-of-Thought Reasoning for Language-driven Grasp Generation7 Oct 2025
- 2025Visual Affordance Prediction: Survey and Reproducibility8 May 2025
- 2024HMT-Grasp: A Hybrid Mamba-Transformer Approach for Robot Grasping in Cluttered Environments4 Oct 2024
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
- 2024Lightweight Language-driven Grasp Detection using Conditional Consistency Model25 Jul 2024
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detection17 Jun 2024
- 2024Simple In-place Data Augmentation for Surveillance Object Detection17 Apr 2024
- 2024Improving the Successful Robotic Grasp Detection Using Convolutional Neural Networks8 Mar 2024
- 2023Open-sourced Data Ecosystem in Autonomous Driving: the Present and Future6 Dec 2023
- 2023GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenes6 Dec 2023
35 more
- 2023FViT-Grasp: Grasping Objects With Using Fast Vision Transformers23 Nov 2023
- 2023Exploring Visual Pre-training for Robot Manipulation: Datasets, Models and Methods7 Aug 2023
- 2023NBMOD: Find It and Grasp It in Noisy Background17 Jun 2023
- 2023Constrained Environment Optimization for Prioritized Multi-Agent Navigation18 May 2023
- 2023Reinforcement Learning for Picking Cluttered General Objects with Dense Object Descriptors20 Apr 2023
- 2023Open-World Object Manipulation using Pre-trained Vision-Language Models2 Mar 2023
- 2023RGB-D Grasp Detection via Depth Guided Learning with Cross-modal Attention28 Feb 2023
- 2023MotorFactory: A Blender Add-on for Large Dataset Generation of Small Electric Motors11 Jan 2023
- 2022MMRNet: Improving Reliability for Multimodal Object Detection and Segmentation for Bin Picking via Multimodal Redundancy19 Oct 2022
- 2022MonoGraspNet: 6-DoF Grasping with a Single RGB Image26 Sep 2022
- 2022Environment Optimization for Multi-Agent Navigation22 Sep 2022
- 2022Top-Tuning: a study on transfer learning for an efficient alternative to fine tuning for image classification with fast kernel methods16 Sep 2022
- 2022A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutions15 Sep 2022
- 2022A Secure and Efficient Multi-Object Grasping Detection Approach for Robotic Arms8 Sep 2022
- 2022DA2 Dataset: Toward Dexterity-Aware Dual-Arm Grasping31 Jul 2022
- 2022Hybrid Physical Metric For 6-DoF Grasp Pose Detection22 Jun 2022
- 2022Evaluating Gaussian Grasp Maps for Generative Grasping Models1 Jun 2022
- 2022Open Arms: Open-Source Arms, Hands & Control20 May 2022
- 2022DcnnGrasp: Towards Accurate Grasp Pattern Recognition with Adaptive Regularizer Learning11 May 2022
- 2022I Know What You Draw: Learning Grasp Detection Conditioned on a Few Freehand Sketches9 May 2022
- 2022PEGG-Net: Pixel-Wise Efficient Grasp Generation in Complex Scenes30 Mar 2022
- 2022When Transformer Meets Robotic Grasping: Exploits Context for Efficient Grasp Detection24 Feb 2022
- 2021Depth-aware Object Segmentation and Grasp Detection for Robotic Picking Tasks22 Nov 2021
- 2021Real-World Semantic Grasp Detection Based on Attention Mechanism20 Nov 2021
- 2021Development of a robust cascaded architecture for intelligent robot grasping using limited labelled data6 Nov 2021
- 2021Learning suction graspability considering grasp quality and robot reachability for bin-picking4 Nov 2021
- 2021A Hybrid Approach for Learning to Shift and Grasp with Elaborate Motion Primitives2 Nov 2021
- 2021Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimation5 Aug 2021
- 2021Double-Dot Network for Antipodal Grasp Detection3 Aug 2021
- 2021GI-NNet & RGI-NNet: Development of Robotic Grasp Pose Models, Trainable with Large as well as Limited Labelled Training Datasets, under supervised and semi supervised paradigms15 Jul 2021
- 2021GKNet: grasp keypoint network for grasp candidates detection16 Jun 2021
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Clutter29 Apr 2021
- 2021A Joint Network for Grasp Detection Conditioned on Natural Language Commands1 Apr 2021
- 2021RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images3 Mar 2021
- 2021Lightweight Convolutional Neural Network with Gaussian-based Grasping Representation for Robotic Grasping Detection25 Jan 2021
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 47
- 2021RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Imagescited by 38
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 34
- 2022MonoGraspNet: 6-DoF Grasping with a Single RGB Imagecited by 24
- 2021A Joint Network for Grasp Detection Conditioned on Natural Language Commandscited by 23
- 2023Open-sourced Data Ecosystem in Autonomous Driving: the Present and Futurecited by 22
- 2021Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimationcited by 14
- 2023Exploring Visual Pre-training for Robot Manipulation: Datasets, Models and Methodscited by 14
- 2022When Transformer Meets Robotic Grasping: Exploits Context for Efficient Grasp Detectioncited by 12
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Cluttercited by 11
- 2022DA2 Dataset: Toward Dexterity-Aware Dual-Arm Graspingcited by 10
- 2023RGB-D Grasp Detection via Depth Guided Learning with Cross-modal Attentioncited by 9
12 most cited of 43 All 43 (JSON)
- 2025Language-Guided Grasp Detection with Coarse-to-Fine Learning for Robotic Manipulation24 Dec 2025
- 2025XGrasp: Gripper-Aware Grasp Detection with Multi-Gripper Data Generation13 Oct 2025
- 2025Visual Affordance Prediction: Survey and Reproducibility8 May 2025
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detection17 Jun 2024
- 2024Simple In-place Data Augmentation for Surveillance Object Detection17 Apr 2024
- 2024Improving the Successful Robotic Grasp Detection Using Convolutional Neural Networks8 Mar 2024
- 2023Open-sourced Data Ecosystem in Autonomous Driving: the Present and Future6 Dec 2023
- 2023GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenes6 Dec 2023
- 2023FViT-Grasp: Grasping Objects With Using Fast Vision Transformers23 Nov 2023
- 2023Exploring Visual Pre-training for Robot Manipulation: Datasets, Models and Methods7 Aug 2023
- 2023NBMOD: Find It and Grasp It in Noisy Background17 Jun 2023
12 newest of 43 All 43 (JSON)