S4G: Amodal Single-view Single-Shot SE(3) Grasp Detection in Cluttered Scenes
Not on the map. Why?
Abstract (arXiv)
Grasping is among the most fundamental and long-lasting problems in robotics study. This paper studies the problem of 6-DoF(degree of freedom) grasping by a parallel gripper in a cluttered scene captured using a commodity depth sensor from a single viewpoint. We address the problem in a learning-based framework. At the high level, we rely on a single-shot grasp proposal network, trained with synthetic data and tested in real-world scenarios. Our single-shot neural network architecture can predict amodal grasp proposal efficiently and effectively. Our training data synthesis pipeline can generate scenes of complex object configuration and leverage an innovative gripper contact model to create dense and high-quality grasp annotations. Experiments in synthetic and real environments have demonstrated that the proposed approach can outperform state-of-the-arts by a large margin.
Key facts. Cited by 51 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 10; 2023: 12; 2024: 10; 2025: 3; 2026: 2.
51 papers.
Sort:
By area:
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 213
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulationcited by 78
- 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objectscited by 64
- 2021AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactionscited by 56
- 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
- 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulationcited by 49
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 47
- 2021O2O-Afford: Annotation-Free Large-Scale Object-Object Affordance Learningcited by 46
- 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modelingcited by 43
38 more
- 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
- 2021RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Imagescited by 38
- 2022Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detectioncited by 34
- 2024OK-Robot: What Really Matters in Integrating Open-Knowledge Models for Roboticscited by 33
- 2024An Economic Framework for 6-DoF Grasp Detectioncited by 23
- 2022Towards Scale Balanced 6-DoF Grasp Detection in Cluttered Scenescited by 21
- 2021DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstrationcited by 20
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidancecited by 16
- 2021Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimationcited by 14
- 2022Contact Points Discovery for Soft-Body Manipulations with Differentiable Physicscited by 14
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Cluttercited by 11
- 2024Efficient Heatmap-Guided 6-Dof Grasp Detection in Cluttered Scenescited by 11
- 2024Generalizing 6-DoF Grasp Detection via Domain Prior Knowledgecited by 11
- 2022Keypoint-GraspNet: Keypoint-based 6-DoF Grasp Generation from the Monocular RGB-D inputcited by 10
- 2021IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor Scenescited by 9
- 2024Part-Guided 3D RL for Sim2Real Articulated Object Manipulationcited by 9
- 2021GKNet: grasp keypoint network for grasp candidates detectioncited by 8
- 2022TransGrasp: Grasp Pose Estimation of a Category of Objects by Transferring Grasps from Only One Labeled Instancecited by 8
- 2023Uncertainty-driven Exploration Strategies for Online Grasp Learningcited by 6
- 2023Perceiving Unseen 3D Objects by Poking the Objectscited by 5
- 2023Model-free Grasping with Multi-Suction Cup Grippers for Robotic Bin Pickingcited by 5
- 2022Hybrid Physical Metric For 6-DoF Grasp Pose Detectioncited by 4
- 2023KGNv2: Separating Scale and Pose Prediction for Keypoint-based 6-DoF Grasp Synthesis on RGB-D inputcited by 4
- 2023Anthropomorphic Grasping with Neural Object Shape Completioncited by 4
- 2023GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenescited by 4
- 2022CoGrasp: 6-DoF Grasp Generation for Human-Robot Collaborationcited by 2
- 2023Grasp Transfer based on Self-Aligning Implicit Representations of Local Surfacescited by 2
- 2024Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projectioncited by 2
- 2024Target-Oriented Object Grasping via Multimodal Human Guidancecited by 2
- 2023CMG-Net: An End-to-End Contact-Based Multi-Finger Dexterous Grasping Networkcited by 1
- 2023Reinforcement Learning for Picking Cluttered General Objects with Dense Object Descriptorscited by 1
- 2025Simultaneous Pick and Place Detection by Combining SE(3) Diffusion Models with Differential Kinematicscited by 1
- 2025Equivariant Volumetric Graspingcited by 1
- 2026EAGG: Embodiment-Aligned Grasp Generation via Geometry-Aware Graph Conditioningcited by 1
- 2022GraspCaps: A Capsule Network Approach for Familiar 6DoF Object Graspingcited by 0
- 2023QwenGrasp: A Usage of Large Vision-Language Model for Target-Oriented Graspingcited by 0
- 2024Self-supervised 6-DoF Robot Grasping by Demonstration via Augmented Reality Teleoperation Systemcited by 0
- 2025SpikeGrasp: A Benchmark for 6-DoF Grasp Pose Detection from Stereo Spike Streamscited by 0
50 most cited of 51 All 51 (JSON)
- 2026GraRe: Grasp Candidate Re-Ranking for Frozen 6-DoF Grasp Detectors2 Aug 2026
- 2026EAGG: Embodiment-Aligned Grasp Generation via Geometry-Aware Graph Conditioning16 Jun 2026
- 2025SpikeGrasp: A Benchmark for 6-DoF Grasp Pose Detection from Stereo Spike Streams12 Oct 2025
- 2025Equivariant Volumetric Grasping24 Jul 2025
- 2025Simultaneous Pick and Place Detection by Combining SE(3) Diffusion Models with Differential Kinematics28 Apr 2025
- 2024Target-Oriented Object Grasping via Multimodal Human Guidance20 Aug 2024
- 2024Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projection22 Jul 2024
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidance18 Jul 2024
- 2024An Economic Framework for 6-DoF Grasp Detection11 Jul 2024
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detection17 Jun 2024
- 2024Part-Guided 3D RL for Sim2Real Articulated Object Manipulation26 Apr 2024
- 2024Self-supervised 6-DoF Robot Grasping by Demonstration via Augmented Reality Teleoperation System3 Apr 2024
38 more
- 2024Generalizing 6-DoF Grasp Detection via Domain Prior Knowledge2 Apr 2024
- 2024Efficient Heatmap-Guided 6-Dof Grasp Detection in Cluttered Scenes27 Mar 2024
- 2024OK-Robot: What Really Matters in Integrating Open-Knowledge Models for Robotics22 Jan 2024
- 2023GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenes6 Dec 2023
- 2023Anthropomorphic Grasping with Neural Object Shape Completion4 Nov 2023
- 2023QwenGrasp: A Usage of Large Vision-Language Model for Target-Oriented Grasping28 Sep 2023
- 2023Uncertainty-driven Exploration Strategies for Online Grasp Learning21 Sep 2023
- 2023Grasp Transfer based on Self-Aligning Implicit Representations of Local Surfaces15 Aug 2023
- 2023Model-free Grasping with Multi-Suction Cup Grippers for Robotic Bin Picking31 Jul 2023
- 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objects9 May 2023
- 2023Reinforcement Learning for Picking Cluttered General Objects with Dense Object Descriptors20 Apr 2023
- 2023CMG-Net: An End-to-End Contact-Based Multi-Finger Dexterous Grasping Network23 Mar 2023
- 2023KGNv2: Separating Scale and Pose Prediction for Keypoint-based 6-DoF Grasp Synthesis on RGB-D input9 Mar 2023
- 2023Perceiving Unseen 3D Objects by Poking the Objects26 Feb 2023
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skills9 Feb 2023
- 2022Towards Scale Balanced 6-DoF Grasp Detection in Cluttered Scenes10 Dec 2022
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulation17 Nov 2022
- 2022Edge Grasp Network: A Graph-Based SE(3)-invariant Approach to Grasp Detection31 Oct 2022
- 2022GraspCaps: A Capsule Network Approach for Familiar 6DoF Object Grasping7 Oct 2022
- 2022CoGrasp: 6-DoF Grasp Generation for Human-Robot Collaboration6 Oct 2022
- 2022Keypoint-GraspNet: Keypoint-based 6-DoF Grasp Generation from the Monocular RGB-D input19 Sep 2022
- 2022TransGrasp: Grasp Pose Estimation of a Category of Objects by Transferring Grasps from Only One Labeled Instance16 Jul 2022
- 2022Hybrid Physical Metric For 6-DoF Grasp Pose Detection22 Jun 2022
- 2022Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics5 May 2022
- 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baseline17 Feb 2022
- 2021IFR-Explore: Learning Inter-object Functional Relationships in 3D Indoor Scenes10 Dec 2021
- 2021DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstration6 Dec 2021
- 2021AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactions1 Dec 2021
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objects27 Oct 2021
- 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objects30 Sep 2021
- 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modeling23 Sep 2021
- 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulation19 Sep 2021
- 2021Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimation5 Aug 2021
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrations30 Jul 2021
- 2021O2O-Afford: Annotation-Free Large-Scale Object-Object Affordance Learning29 Jun 2021
- 2021GKNet: grasp keypoint network for grasp candidates detection16 Jun 2021
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Clutter29 Apr 2021
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenes25 Mar 2021
50 newest of 51 All 51 (JSON)
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 213
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulationcited by 78
- 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objectscited by 64
- 2021AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactionscited by 56
- 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
- 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulationcited by 49
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 47
- 2021O2O-Afford: Annotation-Free Large-Scale Object-Object Affordance Learningcited by 46
- 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modelingcited by 43
12 most cited of 49 All 49 (JSON)
- 2026GraRe: Grasp Candidate Re-Ranking for Frozen 6-DoF Grasp Detectors2 Aug 2026
- 2026EAGG: Embodiment-Aligned Grasp Generation via Geometry-Aware Graph Conditioning16 Jun 2026
- 2025SpikeGrasp: A Benchmark for 6-DoF Grasp Pose Detection from Stereo Spike Streams12 Oct 2025
- 2025Equivariant Volumetric Grasping24 Jul 2025
- 2024Target-Oriented Object Grasping via Multimodal Human Guidance20 Aug 2024
- 2024Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projection22 Jul 2024
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidance18 Jul 2024
- 2024An Economic Framework for 6-DoF Grasp Detection11 Jul 2024
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detection17 Jun 2024
- 2024Part-Guided 3D RL for Sim2Real Articulated Object Manipulation26 Apr 2024
- 2024Self-supervised 6-DoF Robot Grasping by Demonstration via Augmented Reality Teleoperation System3 Apr 2024
- 2024Generalizing 6-DoF Grasp Detection via Domain Prior Knowledge2 Apr 2024
12 newest of 49 All 49 (JSON)