FastGrasp: Efficient Grasp Synthesis with Diffusion
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Effectively modeling the interaction between human hands and objects is challenging due to the complex physical constraints and the requirement for high generation efficiency in applications. Prior approaches often employ computationally intensive two-stage approaches, which first generate an intermediate representation, such as contact maps, followed by an iterative optimization procedure that updates hand meshes to capture the hand-object relation. However, due to the high computation complexity during the optimization stage, such strategies often suffer from low efficiency in inference. To address this limitation, this work introduces a novel diffusion-model-based approach that generates the grasping pose in a one-stage manner. This allows us to significantly improve generation speed and the diversity of generated hand poses. In particular, we develop a Latent Diffusion Model with an Adaptation Module for object-conditioned hand pose generation and a contact-aware loss to enforce the physical constraints between hands and objects. Extensive experiments demonstrate that our method achieves faster inference, higher diversity, and superior pose quality than state-of-the-art approaches. Code is available at hrefhttps://github.com/wuxiaofei01/FastGrasphttps://github.com/wuxiaofei01/FastGrasp.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 40 of its 53 references that are in the map. First posted on arXiv 22 Nov 2024.
Builds on
40 of 53 references.
Closest ancestors · 1
Same direction, newest first
Other references · 39
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
- 2019Learning joint reconstruction of hands and manipulated objectscited by 377
- 2022Diffusion Models already have a Semantic Latent Spacecited by 324
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
27 more
- 2022Novel View Synthesis with Diffusion Modelscited by 299
- 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
- 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 179
- 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 178
- 2021Hand-Object Contact Consistency Reasoning for Human Grasps Generationcited by 160
- 2019ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imagingcited by 145
- 2021Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Timecited by 140
- 2019H+O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactionscited by 139
- 2021ContactOpt: Optimizing Contact to Improve Graspscited by 137
- 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 129
- 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 121
- 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
- 2020HOPE-Net: A Graph-based Model for Hand-Object Pose Estimationcited by 112
- 2021SAGA: Stochastic Whole-Body Grasping with Contactcited by 89
- 2019ContactGrasp: Functional Multi-finger Grasp Synthesis from Contactcited by 87
- 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 84
- 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
- 2022TOCH: Spatio-Temporal Object-to-Hand Correspondence for Motion Refinementcited by 69
- 2022AlignSDF: Pose-Aligned Signed Distance Fields for Hand-Object Reconstructioncited by 58
- 2023CAMS: CAnonicalized Manipulation Spaces for Category-Level Functional Hand-Object Manipulation Synthesiscited by 54
- 2023ContactGen: Generative Contact Modeling for Grasp Generationcited by 52
- 2021A Skeleton-Driven Neural Occupancy Representation for Articulated Handscited by 50
- 2023gSDF: Geometry-Driven Signed Distance Functions for 3D Hand-Object Reconstructioncited by 49
- 2023Task-Oriented Human-Object Interactions Generation with Implicit Neural Representationscited by 41
- 2023Controllable Mesh Generation Through Sparse Latent Point Diffusion Modelscited by 40
- 2024RealDex: Towards Human-like Grasping for Robotic Dexterous Handcited by 33
- 2019Forecasting Human-Object Interaction: Joint Prediction of Motor Attention and Actions in First Person Videocited by 14
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025Pack and Force Your Memory: Long-form and Consistent Video Generationcited by 26
- 2025Contact Map Transfer with Conditional Diffusion Model for Generalizable Dexterous Grasp Generationcited by 3
- 2025Generative Modeling of Shape-Dependent Self-Contact Human Posescited by 2
- 2026AffordGrasp: Cross-Modal Diffusion for Affordance-Aware Grasp Synthesiscited by 1
- 2026SECOND-Grasp: Semantic Contact-guided Dexterous Graspingcited by 0
- 2026Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfercited by 0
- 2026VolCo: Volumetric Contact for High-Fidelity Human Grasp Generationcited by 0
- 2026VolCo: Volumetric Contact for High-Fidelity Human Grasp Generation7 Oct 2026
- 2026Hand-Object Interaction in the Age of Large Foundation Models:Reconstruction, Generation, and Embodied Transfer30 Jul 2026
- 2026SECOND-Grasp: Semantic Contact-guided Dexterous Grasping13 May 2026
- 2026AffordGrasp: Cross-Modal Diffusion for Affordance-Aware Grasp Synthesis9 Mar 2026
- 2025Contact Map Transfer with Conditional Diffusion Model for Generalizable Dexterous Grasp Generation3 Nov 2025
- 2025Pack and Force Your Memory: Long-form and Consistent Video Generation2 Oct 2025
- 2025Generative Modeling of Shape-Dependent Self-Contact Human Poses27 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2024Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model
- 2024DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptions
- 2024ManiDext: Hand-Object Manipulation Synthesis via Continuous Correspondence Embeddings and Residual-Guided Diffusion
- 2024Joint Diffusion for Universal Hand-Object Grasp Generation
- 2026DCGrasp: Distance-aware Controllable Grasp Generation
- 2024Grasp Diffusion Network: Learning Grasp Generators from Partial Point Clouds with Diffusion Models in SO(3)xR3
- 2024Giving a Hand to Diffusion Models: a Two-Stage Approach to Improving Conditional Human Image Generation
- 2024NL2Contact: Natural Language Guided 3D Hand-Object Contact Modeling with Diffusion Model