QDGset: A Large Scale Grasping Dataset Generated with Quality-Diversity
Not on the map. Why?
Abstract (arXiv)
Recent advances in AI have led to significant results in robotic learning, but skills like grasping remain partially solved. Many recent works exploit synthetic grasping datasets to learn to grasp unknown objects. However, those datasets were generated using simple grasp sampling methods using priors. Recently, Quality-Diversity (QD) algorithms have been proven to make grasp sampling significantly more efficient. In this work, we extend QDG-6DoF, a QD framework for generating object-centric grasps, to scale up the production of synthetic grasping datasets. We propose a data augmentation method that combines the transformation of object meshes with transfer learning from previous grasping repertoires. The conducted experiments show that this approach reduces the number of required evaluations per discovered robust grasp by up to 20%. We used this approach to generate QDGset, a dataset of 6DoF grasp poses that contains about 3.5 and 4.5 times more grasps and objects, respectively, than the previous state-of-the-art. Our method allows anyone to easily generate data, eventually contributing to a large-scale collaborative dataset of synthetic grasps.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 37 of its 58 references that are in the map. First posted on arXiv 3 Oct 2024.
Builds on
37 of 58 references.
References · 37
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023A Survey of Large Language Modelscited by 2,576
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2016Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collectioncited by 316
- 2017Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metricscited by 264
- 20196-DOF GraspNet: Variational Grasp Generation for Object Manipulationcited by 242
- 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 209
- 2022SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusioncited by 127
- 2020ACRONYM: A Large-Scale Grasp Dataset Based on Simulationcited by 117
- 2013Deep Learning for Detecting Robotic Graspscited by 116
25 more
- 2015Benchmarking in Manipulation Research: The YCB Object and Model Set and Benchmarking Protocolscited by 99
- 2018Jacquard: A Large Scale Dataset for Robotic Grasp Detectioncited by 87
- 2020Learning Dexterous Grasping with Object-Centric Visual Affordancescited by 85
- 2022From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperationcited by 82
- 2022Deep Learning Approaches to Grasp Synthesis: A Reviewcited by 72
- 2020EGAD! an Evolved Grasping Analysis Dataset for diversity and reproducibility in robotic manipulationcited by 61
- 2023Fast-Grasp'D: Dexterous Multi-finger Grasp Generation Through Differentiable Simulationcited by 35
- 2023Grasp-Anything: Large-scale Grasp Dataset from Foundation Modelscited by 33
- 2019A Billion Ways to Grasp: An Evaluation of Grasp Sampling Schemes on a Dense, Physics-based Grasp Data Setcited by 30
- 2022Learning to Grasp the Ungraspable with Emergent Extrinsic Dexteritycited by 28
- 2023Advancements in Point Cloud Data Augmentation for Deep Learning: A Surveycited by 24
- 2021DemoGrasp: Few-Shot Learning for Robotic Grasping with Human Demonstrationcited by 20
- 2023Transfer Learning in Robotics: An Upcoming Breakthrough? A Review of Promises and Challengescited by 18
- 2022Robotic Grasping from Classical to Modern: A Surveycited by 14
- 2022MetaGraspNet: A Large-Scale Benchmark Dataset for Scene-Aware Ambidextrous Bin Picking via Physics-based Metaverse Synthesiscited by 13
- 2023GraspLDM: Generative 6-DoF Grasp Synthesis using Latent Diffusion Modelscited by 13
- 2023Domain Randomization for Sim2real Transfer of Automatically Generated Grasping Datasetscited by 9
- 2021Few-shot Quality-Diversity Optimizationcited by 8
- 2023Quality Diversity under Sparse Reward and Sparse Interaction: Application to Grasping in Roboticscited by 6
- 2023Real-time Motion Generation and Data Augmentation for Grasping Moving Objects with Dynamic Speed and Position Changescited by 6
- 2024FuncGrasp: Learning Object-Centric Neural Grasp Functions from Single Annotated Example Objectcited by 6
- 2024Speeding up 6-DoF Grasp Sampling with Quality-Diversitycited by 4
- 2018Learning to Grasp from a Single Demonstrationcited by 3
- 2024Vision and Tactile Robotic System to Grasp Litter in Outdoor Environmentscited by 3
- 2023Toward a Plug-and-Play Vision-Based Grasping Module for Roboticscited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.