6-DOF Grasping for Target-driven Object Manipulation in Clutter
Not on the map. Why?
Abstract (arXiv)
Grasping in cluttered environments is a fundamental but challenging robotic skill. It requires both reasoning about unseen object parts and potential collisions with the manipulator. Most existing data-driven approaches avoid this problem by limiting themselves to top-down planar grasps which is insufficient for many real-world scenarios and greatly limits possible grasps. We present a method that plans 6-DOF grasps for any desired object in a cluttered scene from partial point cloud observations. Our method achieves a grasp success of 80.3%, outperforming baseline approaches by 17.6% and clearing 9 cluttered table scenes (which contain 23 unknown objects and 51 picks in total) on a real robotic platform. By using our learned collision checking module, we can even reason about effective grasp sequences to retrieve objects that are not immediately accessible. Supplementary video can be found at https://youtu.be/w0B5S-gCsJk.
Key facts. Cited by 70 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 10; 2023: 19; 2024: 11; 2025: 7; 2026: 3.
70 papers.
Sort:
By area:
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 127
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 106
- 2021ManipulaTHOR: A Framework for Visual Object Manipulationcited by 102
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
- 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesiscited by 57
- 2022Motion Policy Networkscited by 55
- 2022StructDiffusion: Language-Guided Creation of Physically-Valid Structures using Unseen Objectscited by 50
38 more
- 2024DexDiffuser: Generating Dexterous Grasps with Diffusion Modelscited by 48
- 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modelingcited by 43
- 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 41
- 2024Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrationscited by 35
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 35
- 2021NeRP: Neural Rearrangement Planning for Unknown Objectscited by 34
- 2023A Joint Modeling of Vision-Language-Action for Target-oriented Grasping in Cluttercited by 34
- 2021INVIGORATE: Interactive Visual Grounding and Grasping in Cluttercited by 32
- 2025GraspGen: A Diffusion-based Framework for 6-DOF Grasping with On-Generator Trainingcited by 32
- 2021DDGC: Generative Deep Dexterous Grasping in Cluttercited by 29
- 2022Learning to Grasp the Ungraspable with Emergent Extrinsic Dexteritycited by 28
- 2021A Joint Network for Grasp Detection Conditioned on Natural Language Commandscited by 23
- 2024DNAct: Diffusion Guided Multi-Task 3D Policy Learningcited by 23
- 2023CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generationcited by 18
- 2024ICGNet: A Unified Approach for Instance-Centric Graspingcited by 16
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidancecited by 16
- 2021RICE: Refining Instance Masks in Cluttered Environments with Graph Neural Networkscited by 15
- 2024Towards Open-World Grasping with Large Vision-Language Modelscited by 15
- 2021Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimationcited by 14
- 2023GraspLDM: Generative 6-DoF Grasp Synthesis using Latent Diffusion Modelscited by 13
- 2021Collision-Aware Target-Driven Object Grasping in Constrained Environmentscited by 11
- 2021REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Cluttercited by 11
- 2025VISO-Grasp: Vision-Language Informed Spatial Object-centric 6-DoF Active View Planning and Grasping in Clutter and Invisibilitycited by 11
- 2023Self-Supervised Unseen Object Instance Segmentation via Long-Term Robot Interactioncited by 10
- 2021Learning Visual Shape Control of Novel 3D Deformable Objects from Partial-View Point Cloudscited by 9
- 2021GKNet: grasp keypoint network for grasp candidates detectioncited by 8
- 2022Cluttered Food Grasping with Adaptive Fingers and Synthetic-Data Trained Object Detectioncited by 8
- 2022TransGrasp: Grasp Pose Estimation of a Category of Objects by Transferring Grasps from Only One Labeled Instancecited by 8
- 2021Towards Disturbance-Free Visual Mobile Manipulationcited by 6
- 2021Learning suction graspability considering grasp quality and robot reachability for bin-pickingcited by 5
- 2023Out of Sight, Still in Mind: Reasoning and Planning about Unobserved Objects with Video Tracking Enabled Memory Modelscited by 5
- 2023Graph learning in robotics: a surveycited by 5
- 2021Kit-Net: Self-Supervised Learning to Kit Novel 3D Objects into Novel 3D Cavitiescited by 4
- 2022Hybrid Physical Metric For 6-DoF Grasp Pose Detectioncited by 4
- 2023DeformerNet: Learning Bimanual Manipulation of 3D Deformable Objectscited by 4
- 2023SceneScore: Learning a Cost Function for Object Arrangementcited by 4
- 2023GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenescited by 4
- 2024Grasp Diffusion Network: Learning Grasp Generators from Partial Point Clouds with Diffusion Models in SO(3)xR3cited by 4
50 most cited of 70 All 70 (JSON)
- 2026RealVLG-R1: A Large-Scale Real-World Visual-Language Grounding Benchmark for Robotic Perception and Manipulation16 Mar 2026
- 2026Language-Guided Grasping under Partial Observation for Mobile Manipulation in Field Inspection and Maintenance9 Mar 2026
- 2026Informative Object-centric Next Best View for Object-aware 3D Gaussian Splatting in Cluttered Scenes9 Feb 2026
- 2025ADPro: a Test-time Adaptive Diffusion Policy via Manifold-constrained Denoising and Task-aware Initialization for Robotic Manipulation8 Aug 2025
- 2025GraspGen: A Diffusion-based Framework for 6-DOF Grasping with On-Generator Training17 Jul 2025
- 2025DiffDef: A Diffusion Model for Generating Multimodal Goal Shapes From Demonstrations for Deformable Object Manipulation23 Jun 2025
- 2025PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Grasp22 Apr 2025
- 2025VISO-Grasp: Vision-Language Informed Spatial Object-centric 6-DoF Active View Planning and Grasping in Clutter and Invisibility16 Mar 2025
- 2025Efficient Alignment of Unconditioned Action Prior for Language-conditioned Pick and Place in Clutter12 Mar 2025
- 2025Bring Your Own Grasp Generator: Leveraging Robot Grasp Generation for Prosthetic Grasping1 Mar 2025
- 2024Grasp Diffusion Network: Learning Grasp Generators from Partial Point Clouds with Diffusion Models in SO(3)xR311 Dec 2024
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
38 more
- 2024Target-Oriented Object Grasping via Multimodal Human Guidance20 Aug 2024
- 2024Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrations8 Aug 2024
- 2024LAC-Net: Linear-Fusion Attention-Guided Convolutional Network for Accurate Robotic Grasping Under the Occlusion6 Aug 2024
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidance18 Jul 2024
- 2024Towards Open-World Grasping with Large Vision-Language Models26 Jun 2024
- 2024Human-centered In-building Embodied Delivery Benchmark25 Jun 2024
- 2024DNAct: Diffusion Guided Multi-Task 3D Policy Learning7 Mar 2024
- 2024DexDiffuser: Generating Dexterous Grasps with Diffusion Models5 Feb 2024
- 2024ICGNet: A Unified Approach for Instance-Centric Grasping18 Jan 2024
- 2023GraspLDM: Generative 6-DoF Grasp Synthesis using Latent Diffusion Models18 Dec 2023
- 2023GraNet: A Multi-Level Graph Network for 6-DoF Grasp Pose Generation in Cluttered Scenes6 Dec 2023
- 2023SceneScore: Learning a Cost Function for Object Arrangement14 Nov 2023
- 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Place2 Nov 2023
- 2023Graph learning in robotics: a survey6 Oct 2023
- 2023QwenGrasp: A Usage of Large Vision-Language Model for Target-Oriented Grasping28 Sep 2023
- 2023Out of Sight, Still in Mind: Reasoning and Planning about Unobserved Objects with Video Tracking Enabled Memory Models26 Sep 2023
- 2023DefGoalNet: Contextual Goal Learning from Demonstrations For Deformable Object Manipulation25 Sep 2023
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fields31 Aug 2023
- 2023Grasp Transfer based on Self-Aligning Implicit Representations of Local Surfaces15 Aug 2023
- 2023HomeRobot: Open-Vocabulary Mobile Manipulation20 Jun 2023
- 2023DeformerNet: Learning Bimanual Manipulation of 3D Deformable Objects8 May 2023
- 2023Spatial-Language Attention Policies for Efficient Robot Learning21 Apr 2023
- 2023CabiNet: Scaling Neural Collision Detection for Object Rearrangement with Procedural Scene Generation18 Apr 2023
- 2023GoferBot: A Visual Guided Human-Robot Collaborative Assembly System18 Apr 2023
- 2023CMG-Net: An End-to-End Contact-Based Multi-Finger Dexterous Grasping Network23 Mar 2023
- 2023A Joint Modeling of Vision-Language-Action for Target-oriented Grasping in Clutter24 Feb 2023
- 2023Self-Supervised Unseen Object Instance Segmentation via Long-Term Robot Interaction7 Feb 2023
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis18 Jan 2023
- 2022StructDiffusion: Language-Guided Creation of Physically-Valid Structures using Unseen Objects8 Nov 2022
- 2022Learning to Grasp the Ungraspable with Emergent Extrinsic Dexterity2 Nov 2022
- 2022Motion Policy Networks21 Oct 2022
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulation12 Sep 2022
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusion8 Sep 2022
- 2022TransGrasp: Grasp Pose Estimation of a Category of Objects by Transferring Grasps from Only One Labeled Instance16 Jul 2022
- 2022Neural Motion Fields: Encoding Grasp Trajectories as Implicit Value Functions29 Jun 2022
- 2022Hybrid Physical Metric For 6-DoF Grasp Pose Detection22 Jun 2022
- 2022GloCAL: Glocalized Curriculum-Aided Learning of Multiple Tasks with Application to Robotic Grasping14 Apr 2022
- 2022Cluttered Food Grasping with Adaptive Fingers and Synthetic-Data Trained Object Detection10 Mar 2022
50 newest of 70 All 70 (JSON)
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 127
- 2022StructDiffusion: Language-Guided Creation of Physically-Valid Structures using Unseen Objectscited by 50
- 2024DexDiffuser: Generating Dexterous Grasps with Diffusion Modelscited by 48
- 2023GraspLDM: Generative 6-DoF Grasp Synthesis using Latent Diffusion Modelscited by 13
- 2024Grasp Diffusion Network: Learning Grasp Generators from Partial Point Clouds with Diffusion Models in SO(3)xR3cited by 4
- 2025ADPro: a Test-time Adaptive Diffusion Policy via Manifold-constrained Denoising and Task-aware Initialization for Robotic Manipulationcited by 4
- 2025DiffDef: A Diffusion Model for Generating Multimodal Goal Shapes From Demonstrations for Deformable Object Manipulationcited by 0
- 2025ADPro: a Test-time Adaptive Diffusion Policy via Manifold-constrained Denoising and Task-aware Initialization for Robotic Manipulation8 Aug 2025
- 2025DiffDef: A Diffusion Model for Generating Multimodal Goal Shapes From Demonstrations for Deformable Object Manipulation23 Jun 2025
- 2024Grasp Diffusion Network: Learning Grasp Generators from Partial Point Clouds with Diffusion Models in SO(3)xR311 Dec 2024
- 2024DexDiffuser: Generating Dexterous Grasps with Diffusion Models5 Feb 2024
- 2023GraspLDM: Generative 6-DoF Grasp Synthesis using Latent Diffusion Models18 Dec 2023
- 2022StructDiffusion: Language-Guided Creation of Physically-Valid Structures using Unseen Objects8 Nov 2022
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusion8 Sep 2022
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 106
- 2021ManipulaTHOR: A Framework for Visual Object Manipulationcited by 102
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
- 2021BundleTrack: 6D Pose Tracking for Novel Objects without Instance or Category-Level 3D Modelscited by 87
- 2022Motion Policy Networkscited by 55
- 2021Unseen Object Amodal Instance Segmentation via Hierarchical Occlusion Modelingcited by 43
- 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 41
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulationcited by 35
12 most cited of 58 All 58 (JSON)
- 2026RealVLG-R1: A Large-Scale Real-World Visual-Language Grounding Benchmark for Robotic Perception and Manipulation16 Mar 2026
- 2026Language-Guided Grasping under Partial Observation for Mobile Manipulation in Field Inspection and Maintenance9 Mar 2026
- 2026Informative Object-centric Next Best View for Object-aware 3D Gaussian Splatting in Cluttered Scenes9 Feb 2026
- 2025GraspGen: A Diffusion-based Framework for 6-DOF Grasping with On-Generator Training17 Jul 2025
- 2025PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Grasp22 Apr 2025
- 2025VISO-Grasp: Vision-Language Informed Spatial Object-centric 6-DoF Active View Planning and Grasping in Clutter and Invisibility16 Mar 2025
- 2025Efficient Alignment of Unconditioned Action Prior for Language-conditioned Pick and Place in Clutter12 Mar 2025
- 2025Bring Your Own Grasp Generator: Leveraging Robot Grasp Generation for Prosthetic Grasping1 Mar 2025
- 2024A Survey of Embodied Learning for Object-Centric Robotic Manipulation21 Aug 2024
- 2024Target-Oriented Object Grasping via Multimodal Human Guidance20 Aug 2024
- 2024LAC-Net: Linear-Fusion Attention-Guided Convolutional Network for Accurate Robotic Grasping Under the Occlusion6 Aug 2024
- 2024Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidance18 Jul 2024
12 newest of 58 All 58 (JSON)