Real-Time Grasp Detection Using Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
We present an accurate, real-time approach to robotic grasp detection based on convolutional neural networks. Our network performs single-stage regression to graspable bounding boxes without using standard sliding window or region proposal techniques. The model outperforms state-of-the-art approaches by 14 percentage points and runs at 13 frames per second on a GPU. Our network can simultaneously perform classification so that in a single step it recognizes the object and finds a good grasp rectangle. A modification to this model predicts multiple grasps per object by using a locally constrained prediction mechanism. The locally constrained model performs significantly better, especially on objects that can be grasped in a variety of ways.
Key facts. Cited by 76 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Dec 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 22; 2022: 17; 2023: 13; 2024: 14; 2025: 7; 2026: 2.
76 papers.
Sort:
By area:
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 124
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2022DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Videocited by 89
- 2024GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Graspingcited by 78
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 72
- 2021AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactionscited by 57
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesiscited by 57
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 48
- 2021O2O-Afford: Annotation-Free Large-Scale Object-Object Affordance Learningcited by 46
- 2021End-to-end Trainable Deep Neural Network for Robotic Grasp Detection and Semantic Segmentation from RGBcited by 44
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splattingcited by 41
- 2021RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Imagescited by 39
38 more
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 35
- 2021INVIGORATE: Interactive Visual Grounding and Grasping in Cluttercited by 32
- 2022MonoGraspNet: 6-DoF Grasping with a Single RGB Imagecited by 24
- 2021A Joint Network for Grasp Detection Conditioned on Natural Language Commandscited by 23
- 2024An Economic Framework for 6-DoF Grasp Detectioncited by 23
- 2021DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstrationcited by 20
- 2022DualAfford: Learning Collaborative Visual Affordance for Dual-gripper Manipulationcited by 18
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidancecited by 16
- 2023Exploring Visual Pre-training for Robot Manipulation: Datasets, Models and Methodscited by 15
- 2021Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimationcited by 14
- 20233DSGrasp: 3D Shape-Completion for Robotic Graspcited by 13
- 2022When Transformer Meets Robotic Grasping: Exploits Context for Efficient Grasp Detectioncited by 12
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Cluttercited by 11
- 2022DA2 Dataset: Toward Dexterity-Aware Dual-Arm Graspingcited by 11
- 2021IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor Scenescited by 9
- 2023RGB-D Grasp Detection via Depth Guided Learning with Cross-modal Attentioncited by 9
- 2024Lightweight Language-driven Grasp Detection using Conditional Consistency Modelcited by 9
- 2021GKNet: grasp keypoint network for grasp candidates detectioncited by 8
- 2023Sim-Suction: Learning a Suction Grasp Policy for Cluttered Environments Using a Synthetic Benchmarkcited by 7
- 2021Transferring Experience from Simulation to the Real World for Precise Pick-And-Place Tasks in Highly Cluttered Scenescited by 6
- 2021A Hybrid Approach for Learning to Shift and Grasp with Elaborate Motion Primitivescited by 6
- 2022Visual-tactile Fusion for Transparent Object Grasping in Complex Backgroundscited by 5
- 2021HANDS: A Multimodal Dataset for Modeling Towards Human Grasp Intent Inference in Prosthetic Handscited by 4
- 2022I Know What You Draw: Learning Grasp Detection Conditioned on a Few Freehand Sketchescited by 4
- 2022Hybrid Physical Metric For 6-DoF Grasp Pose Detectioncited by 4
- 2023Fine-Tuning Generative Models as an Inference Method for Robotic Taskscited by 4
- 2023GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenescited by 4
- 2021Depth-aware Object Segmentation and Grasp Detection for Robotic Picking Taskscited by 3
- 2022Open Arms: Open-Source Arms, Hands & Controlcited by 3
- 2022PoseIt: A Visual-Tactile Dataset of Holding Poses for Grasp Stability Analysiscited by 3
- 2023NBMOD: Find It and Grasp It in Noisy Backgroundcited by 3
- 2024Improving the Successful Robotic Grasp Detection Using Convolutional Neural Networkscited by 3
- 2024GraspMamba: A Mamba-based Language-driven Grasp Detection Framework with Hierarchical Feature Learningcited by 3
- 2024Bimanual Grasp Synthesis for Dexterous Robot Handscited by 3
- 2021Double-Dot Network for Antipodal Grasp Detectioncited by 2
- 2022A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutionscited by 2
- 2024AGILE: Approach-based Grasp Inference Learned from Element Decompositioncited by 2
- 2024HMT-Grasp: A Hybrid Mamba-Transformer Approach for Robot Grasping in Cluttered Environmentscited by 2
50 most cited of 76 All 76 (JSON)
- 2026Connectivity-Aware Exploration of Robotic Grasp Spaces19 Sep 2026
- 2026Towards Space-Based Environmentally-Adaptive Grasping29 Jan 2026
- 2025Deep Learning Architectures for Code-Modulated Visual Evoked Potentials Detection26 Nov 2025
- 2025XGrasp: Gripper-Aware Grasp Detection with Multi-Gripper Data Generation13 Oct 2025
- 2025VCoT-Grasp: Grasp Foundation Models with Visual Chain-of-Thought Reasoning for Language-driven Grasp Generation7 Oct 2025
- 2025An Overview of Arithmetic Adaptations for Inference of Convolutional Neural Networks on Re-configurable Hardware19 May 2025
- 2025Visual Affordance Prediction: Survey and Reproducibility8 May 2025
- 2025Prompt-responsive Object Retrieval with Memory-augmented Student-Teacher Learning4 May 2025
- 2025A Benchmarking Study of Vision-based Robotic Grasping Algorithms14 Mar 2025
- 2024Bimanual Grasp Synthesis for Dexterous Robot Hands24 Nov 2024
- 2024Self-supervised cross-modality learning for uncertainty-aware object detection and recognition in applications which lack pre-labelled training data5 Nov 2024
- 2024HMT-Grasp: A Hybrid Mamba-Transformer Approach for Robot Grasping in Cluttered Environments4 Oct 2024
38 more
- 2024GraspMamba: A Mamba-based Language-driven Grasp Detection Framework with Hierarchical Feature Learning22 Sep 2024
- 2024Robust Loss Functions for Object Grasping under Limited Ground Truth9 Sep 2024
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splatting3 Sep 2024
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
- 2024Lightweight Language-driven Grasp Detection using Conditional Consistency Model25 Jul 2024
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidance18 Jul 2024
- 2024An Economic Framework for 6-DoF Grasp Detection11 Jul 2024
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detection17 Jun 2024
- 2024GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Grasping14 Mar 2024
- 2024Improving the Successful Robotic Grasp Detection Using Convolutional Neural Networks8 Mar 2024
- 2024AGILE: Approach-based Grasp Inference Learned from Element Decomposition2 Feb 2024
- 2023GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenes6 Dec 2023
- 2023FViT-Grasp: Grasping Objects With Using Fast Vision Transformers23 Nov 2023
- 2023Modular Anti-noise Deep Learning Network for Robotic Grasp Detection Based on RGB Images30 Oct 2023
- 2023Fine-Tuning Generative Models as an Inference Method for Robotic Tasks19 Oct 2023
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigation9 Aug 2023
- 2023Exploring Visual Pre-training for Robot Manipulation: Datasets, Models and Methods7 Aug 2023
- 2023NBMOD: Find It and Grasp It in Noisy Background17 Jun 2023
- 2023Sim-Suction: Learning a Suction Grasp Policy for Cluttered Environments Using a Synthetic Benchmark25 May 2023
- 2023Sim-MEES: Modular End-Effector System Grasping Dataset for Mobile Manipulators in Cluttered Environments17 May 2023
- 2023RGB-D Grasp Detection via Depth Guided Learning with Cross-modal Attention28 Feb 2023
- 2023Online Tool Selection with Learned Grasp Prediction Models15 Feb 2023
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis18 Jan 2023
- 20233DSGrasp: 3D Shape-Completion for Robotic Grasp2 Jan 2023
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactions14 Dec 2022
- 2022Visual-tactile Fusion for Transparent Object Grasping in Complex Backgrounds30 Nov 2022
- 2022MonoGraspNet: 6-DoF Grasping with a Single RGB Image26 Sep 2022
- 2022GP-net: Flexible Viewpoint Grasp Proposal21 Sep 2022
- 2022A Robotic Visual Grasping Design: Rethinking Convolution Neural Network with High-Resolutions15 Sep 2022
- 2022PoseIt: A Visual-Tactile Dataset of Holding Poses for Grasp Stability Analysis12 Sep 2022
- 2022DA2 Dataset: Toward Dexterity-Aware Dual-Arm Grasping31 Jul 2022
- 2022DualAfford: Learning Collaborative Visual Affordance for Dual-gripper Manipulation5 Jul 2022
- 2022Hybrid Physical Metric For 6-DoF Grasp Pose Detection22 Jun 2022
- 2022Evaluating Gaussian Grasp Maps for Generative Grasping Models1 Jun 2022
- 2022Open Arms: Open-Source Arms, Hands & Control20 May 2022
- 2022I Know What You Draw: Learning Grasp Detection Conditioned on a Few Freehand Sketches9 May 2022
- 2022PEGG-Net: Pixel-Wise Efficient Grasp Generation in Complex Scenes30 Mar 2022
- 2022VGQ-CNN: Moving Beyond Fixed Cameras and Top-Grasps for Grasp Quality Prediction9 Mar 2022
50 newest of 76 All 76 (JSON)
- 2026Towards Space-Based Environmentally-Adaptive Graspingcited by 0
- 2026Towards Space-Based Environmentally-Adaptive Grasping29 Jan 2026
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 124
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2022DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Videocited by 89
- 2024GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Graspingcited by 78
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 72
- 2021AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactionscited by 57
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 48
- 2021O2O-Afford: Annotation-Free Large-Scale Object-Object Affordance Learningcited by 46
- 2021End-to-end Trainable Deep Neural Network for Robotic Grasp Detection and Semantic Segmentation from RGBcited by 44
- 2021RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Imagescited by 39
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 35
- 2021INVIGORATE: Interactive Visual Grounding and Grasping in Cluttercited by 32
12 most cited of 68 All 68 (JSON)
- 2026Connectivity-Aware Exploration of Robotic Grasp Spaces19 Sep 2026
- 2025Deep Learning Architectures for Code-Modulated Visual Evoked Potentials Detection26 Nov 2025
- 2025XGrasp: Gripper-Aware Grasp Detection with Multi-Gripper Data Generation13 Oct 2025
- 2025An Overview of Arithmetic Adaptations for Inference of Convolutional Neural Networks on Re-configurable Hardware19 May 2025
- 2025Visual Affordance Prediction: Survey and Reproducibility8 May 2025
- 2025Prompt-responsive Object Retrieval with Memory-augmented Student-Teacher Learning4 May 2025
- 2025A Benchmarking Study of Vision-based Robotic Grasping Algorithms14 Mar 2025
- 2024Bimanual Grasp Synthesis for Dexterous Robot Hands24 Nov 2024
- 2024Self-supervised cross-modality learning for uncertainty-aware object detection and recognition in applications which lack pre-labelled training data5 Nov 2024
- 2024Robust Loss Functions for Object Grasping under Limited Ground Truth9 Sep 2024
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidance18 Jul 2024
12 newest of 68 All 68 (JSON)