6-DOF GraspNet: Variational Grasp Generation for Object Manipulation
Not on the map. Why?
Abstract (arXiv)
Generating grasp poses is a crucial component for any robot object manipulation task. In this work, we formulate the problem of grasp generation as sampling a set of grasps using a variational autoencoder and assess and refine the sampled grasps using a grasp evaluator model. Both Grasp Sampler and Grasp Refinement networks take 3D point clouds observed by a depth camera as input. We evaluate our approach in simulation and real-world robot experiments. Our approach achieves 88% success rate on various commonly used objects with diverse appearances, scales, and weights. Our model is trained purely in simulation and works in the real world without any extra steps. The video of our experiments can be found at: https://research.nvidia.com/publication/2019-106-DOF-GraspNet%3A-Variational
Key facts. Cited by 237 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 41; 2023: 45; 2024: 52; 2025: 41; 2026: 19.
237 papers.
Sort:
By area:
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 213
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
- 2021Hand-Object Contact Consistency Reasoning for Human Grasps Generationcited by 160
- 2021A System for General In-Hand Object Re-Orientationcited by 155
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 125
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 120
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
38 more
- 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 107
- 2022DALL-E-Bot: Introducing Web-Scale Diffusion Models to Roboticscited by 105
- 2022Navigating to Objects in the Real Worldcited by 104
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 104
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
- 2023Language Embedded Radiance Fields for Zero-Shot Task-Oriented Graspingcited by 91
- 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 84
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulationcited by 78
- 2022Category-Level 6D Object Pose and Size Estimation using Self-Supervised Deep Prior Deformation Networkscited by 73
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2021StructFormer: Learning Spatial Structure for Language-Guided Semantic Rearrangement of Novel Objectscited by 57
- 2023NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesiscited by 56
- 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
- 2022GenDexGrasp: Generalizable Dexterous Graspingcited by 54
- 2022Motion Policy Networkscited by 53
- 2023ContactGen: Generative Contact Modeling for Grasp Generationcited by 52
- 2021Human Hands as Probes for Interactive Object Understandingcited by 51
- 2022SE(3)-Equivariant Relational Rearrangement with Neural Descriptor Fieldscited by 51
- 2022HouseCat6D -- A Large-Scale Multi-Modal Category Level 6D Object Perception Dataset with Household Objects in Realistic Scenarioscited by 51
- 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 51
- 2021A Skeleton-Driven Neural Occupancy Representation for Articulated Handscited by 50
- 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulationcited by 49
- 2024Graspness Discovery in Clutters for Fast and Accurate Grasp Detectioncited by 47
- 2024DexDiffuser: Generating Dexterous Grasps with Diffusion Modelscited by 46
- 2022Discovering Objects that Can Movecited by 44
- 2021Language Grounding with 3D Objectscited by 43
- 2022IFOR: Iterative Flow Minimization for Robotic Object Rearrangementcited by 42
- 2023When Prompt-based Incremental Learning Does Not Meet Strong Pretrainingcited by 41
- 2024Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimationcited by 41
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splattingcited by 41
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 41
- 2023IST-Net: Prior-free Category-level Pose Estimation with Implicit Space Transformationcited by 40
- 2023VI-Net: Boosting Category-level 6D Object Pose Estimation via Learning Decoupled Rotations on the Spherical Representationscited by 40
- 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 40
- 2024EmbodiedSAM: Online Segment Any 3D Thing in Real Timecited by 40
- 2024RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulationcited by 40
- 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
- 2023Compositional Diffusion-Based Continuous Constraint Solverscited by 39
50 most cited of 237 All 237 (JSON)
- 2026Continual Learning for 6-DoF Grasp Synthesis via Experience and Demonstrations1 Oct 2026
- 2026SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation15 Aug 2026
- 2026GraRe: Grasp Candidate Re-Ranking for Frozen 6-DoF Grasp Detectors2 Aug 2026
- 2026Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applications18 Jun 2026
- 2026EAGG: Embodiment-Aligned Grasp Generation via Geometry-Aware Graph Conditioning16 Jun 2026
- 2026Human Universal Grasping15 Jun 2026
- 2026EquiDexFlow: Contact-Grounded SE(3)-Equivariant Dexterous Grasp Generative Flows10 Jun 2026
- 2026EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation8 Jun 2026
- 2026GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priors7 Jun 2026
- 2026A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimation5 Jun 2026
- 2026Grasp-Then-Plan with Failure Attribution: A Closed Two-Stage Framework for Precise and Generalizable Robotic Manipulation2 Jun 2026
- 2026ESAM++: Efficient Online 3D Perception on the Edge28 May 2026
38 more
- 2026RepSAM: Bridging Foundation Models to Robotic Vision via Representation-Guided Adaptation25 May 2026
- 2026ComPose: When to Trust Hands for Object Pose Tracking22 May 2026
- 2026OnlinePG: Online Open-Vocabulary Panoptic Mapping with 3D Gaussian Splatting19 Mar 2026
- 2026MessyKitchens: Contact-rich object-level 3D scene reconstruction17 Mar 2026
- 2026RealVLG-R1: A Large-Scale Real-World Visual-Language Grounding Benchmark for Robotic Perception and Manipulation16 Mar 2026
- 2026EmbodiedSplat: Online Feed-Forward Semantic 3DGS for Open-Vocabulary 3D Scene Understanding4 Mar 2026
- 2026GraspLDP: Towards Generalizable Grasping Policy via Latent Diffusion26 Feb 2026
- 2025MoonSeg3R: Monocular Online Zero-Shot Segment Anything in 3D with Reconstructive Foundation Priors17 Dec 2025
- 2025CRAFT-E: A Neuro-Symbolic Framework for Embodied Affordance Grounding3 Dec 2025
- 2025Diagnose, Correct, and Learn from Manipulation Failures via Visual Symbols2 Dec 2025
- 2025VLAD-Grasp: Zero-shot Grasp Detection via Vision-Language Models8 Nov 2025
- 2025MachaGrasp: Morphology-Aware Cross-Embodiment Dexterous Hand Articulation Generation for Grasping7 Oct 2025
- 2025VCoT-Grasp: Grasp Foundation Models with Visual Chain-of-Thought Reasoning for Language-driven Grasp Generation7 Oct 2025
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation5 Oct 2025
- 2025GraspFactory: A Large Object-Centric Grasping Dataset24 Sep 2025
- 2025Grasp-MPC: Closed-Loop Visual Grasping via Value-Guided Model Predictive Control7 Sep 2025
- 2025Weakly-Supervised Learning of Dense Functional Correspondences4 Sep 2025
- 2025Visuomotor Grasping with World Models for Surgical Robots15 Aug 2025
- 2025Toward Human-Robot Teaming: Learning Handover Behaviors from 3D Scenes13 Aug 2025
- 2025ADPro: a Test-time Adaptive Diffusion Policy via Manifold-constrained Denoising and Task-aware Initialization for Robotic Manipulation8 Aug 2025
- 2025Rethinking Transparent Object Grasping: Depth Completion with Monocular Depth Estimation and Instance Mask4 Aug 2025
- 2025ModelNet40-E: An Uncertainty-Aware Benchmark for Point Cloud Classification2 Aug 2025
- 2025Equivariant Volumetric Grasping24 Jul 2025
- 2025GraspGen: A Diffusion-based Framework for 6-DOF Grasping with On-Generator Training17 Jul 2025
- 2025A Multi-Level Similarity Approach for Single-View Object Grasping: Matching, Planning, and Fine-Tuning16 Jul 2025
- 2025Learning human-to-robot handovers through 3D scene reconstruction11 Jul 2025
- 2025SE(3)-Equivariant Diffusion Policy in Spherical Fourier Space2 Jul 2025
- 2025GeoCD: A Differential Local Approximation for Geodesic Chamfer Distance30 Jun 2025
- 2025DiffDef: A Diffusion Model for Generating Multimodal Goal Shapes From Demonstrations for Deformable Object Manipulation23 Jun 2025
- 2025Monocular One-Shot Metric-Depth Alignment for RGB-Based Robot Grasping20 Jun 2025
- 2025Manipulating Elasto-Plastic Objects With 3D Occupancy and Learning-Based Predictive Control22 May 2025
- 2025Exploiting Radiance Fields for Grasp Generation on Novel Synthetic Views16 May 2025
- 2025Visual Affordance Prediction: Survey and Reproducibility8 May 2025
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Data6 May 2025
- 2025Simultaneous Pick and Place Detection by Combining SE(3) Diffusion Models with Differential Kinematics28 Apr 2025
- 2025PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Grasp22 Apr 2025
- 2025ZeroGrasp: Zero-Shot Shape Reconstruction Enabled Robotic Grasping15 Apr 2025
- 2025Diffusion Models for Robotic Manipulation: A Survey11 Apr 2025
50 newest of 237 All 237 (JSON)
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 125
- 2022DALL-E-Bot: Introducing Web-Scale Diffusion Models to Roboticscited by 105
- 2024DexDiffuser: Generating Dexterous Grasps with Diffusion Modelscited by 46
- 2025Diffusion Models for Robotic Manipulation: A Surveycited by 39
- 2024Language-driven Grasp Detectioncited by 26
- 2024M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenescited by 26
- 2024GenDP: 3D Semantic Fields for Category-Level Generalizable Diffusion Policycited by 25
- 2023ReorientDiff: Diffusion Model based Reorientation for Object Manipulationcited by 19
- 2023GraspLDM: Generative 6-DoF Grasp Synthesis using Latent Diffusion Modelscited by 13
- 2025SE(3)-Equivariant Diffusion Policy in Spherical Fourier Spacecited by 7
- 2024Grasp Diffusion Network: Learning Grasp Generators from Partial Point Clouds with Diffusion Models in SO(3)xR3cited by 4
- 2025ADPro: a Test-time Adaptive Diffusion Policy via Manifold-constrained Denoising and Task-aware Initialization for Robotic Manipulationcited by 4
12 most cited of 17 All 17 (JSON)
- 2026GraspLDP: Towards Generalizable Grasping Policy via Latent Diffusion26 Feb 2026
- 2025Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation5 Oct 2025
- 2025ADPro: a Test-time Adaptive Diffusion Policy via Manifold-constrained Denoising and Task-aware Initialization for Robotic Manipulation8 Aug 2025
- 2025SE(3)-Equivariant Diffusion Policy in Spherical Fourier Space2 Jul 2025
- 2025DiffDef: A Diffusion Model for Generating Multimodal Goal Shapes From Demonstrations for Deformable Object Manipulation23 Jun 2025
- 2025Simultaneous Pick and Place Detection by Combining SE(3) Diffusion Models with Differential Kinematics28 Apr 2025
- 2025Diffusion Models for Robotic Manipulation: A Survey11 Apr 2025
- 2025HGDiffuser: Efficient Task-Oriented Grasp Generation via Human-Guided Grasp Diffusion Models1 Mar 2025
- 2024Grasp Diffusion Network: Learning Grasp Generators from Partial Point Clouds with Diffusion Models in SO(3)xR311 Dec 2024
- 2024GenDP: 3D Semantic Fields for Category-Level Generalizable Diffusion Policy23 Oct 2024
- 2024M2Diffuser: Diffusion-based Trajectory Optimization for Mobile Manipulation in 3D Scenes15 Oct 2024
- 2024Language-driven Grasp Detection13 Jun 2024
12 newest of 17 All 17 (JSON)
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splattingcited by 41
- 2024Towards Open-World Grasping with Large Vision-Language Modelscited by 13
- 2024PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Modelscited by 11
- 2025Weakly-Supervised Learning of Dense Functional Correspondencescited by 2
- 2023QwenGrasp: A Usage of Large Vision-Language Model for Target-Oriented Graspingcited by 0
- 2025VLAD-Grasp: Zero-shot Grasp Detection via Vision-Language Modelscited by 0
- 2025VLAD-Grasp: Zero-shot Grasp Detection via Vision-Language Models8 Nov 2025
- 2025Weakly-Supervised Learning of Dense Functional Correspondences4 Sep 2025
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splatting3 Sep 2024
- 2024Towards Open-World Grasping with Large Vision-Language Models26 Jun 2024
- 2024PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Models26 Feb 2024
- 2023QwenGrasp: A Usage of Large Vision-Language Model for Target-Oriented Grasping28 Sep 2023
- 2025Visuomotor Grasping with World Models for Surgical Robots15 Aug 2025
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 213
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
- 2021Hand-Object Contact Consistency Reasoning for Human Grasps Generationcited by 160
- 2021A System for General In-Hand Object Re-Orientationcited by 155
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2021Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representationscited by 107
- 2022Navigating to Objects in the Real Worldcited by 104
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 104
12 most cited of 206 All 206 (JSON)
- 2026Continual Learning for 6-DoF Grasp Synthesis via Experience and Demonstrations1 Oct 2026
- 2026SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation15 Aug 2026
- 2026GraRe: Grasp Candidate Re-Ranking for Frozen 6-DoF Grasp Detectors2 Aug 2026
- 2026Efficiently Linking Real Scenes with Synthetic Data Generation for AI-based Cognitive Robotics and Computer Vision Applications18 Jun 2026
- 2026EAGG: Embodiment-Aligned Grasp Generation via Geometry-Aware Graph Conditioning16 Jun 2026
- 2026Human Universal Grasping15 Jun 2026
- 2026EquiDexFlow: Contact-Grounded SE(3)-Equivariant Dexterous Grasp Generative Flows10 Jun 2026
- 2026EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation8 Jun 2026
- 2026GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priors7 Jun 2026
- 2026A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimation5 Jun 2026
- 2026Grasp-Then-Plan with Failure Attribution: A Closed Two-Stage Framework for Precise and Generalizable Robotic Manipulation2 Jun 2026
- 2026ESAM++: Efficient Online 3D Perception on the Edge28 May 2026
12 newest of 206 All 206 (JSON)