mlsanityData to 7 Oct 2026

FastGrasp: Efficient Grasp Synthesis with Diffusion

arXiv 2411.14786 ↗First posted 22 Nov 2024cs.RO cs.CVcited by 7

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

Effectively modeling the interaction between human hands and objects is challenging due to the complex physical constraints and the requirement for high generation efficiency in applications. Prior approaches often employ computationally intensive two-stage approaches, which first generate an intermediate representation, such as contact maps, followed by an iterative optimization procedure that updates hand meshes to capture the hand-object relation. However, due to the high computation complexity during the optimization stage, such strategies often suffer from low efficiency in inference. To address this limitation, this work introduces a novel diffusion-model-based approach that generates the grasping pose in a one-stage manner. This allows us to significantly improve generation speed and the diversity of generated hand poses. In particular, we develop a Latent Diffusion Model with an Adaptation Module for object-conditioned hand pose generation and a contact-aware loss to enforce the physical constraints between hands and objects. Extensive experiments demonstrate that our method achieves faster inference, higher diversity, and superior pose quality than state-of-the-art approaches. Code is available at hrefhttps://github.com/wuxiaofei01/FastGrasphttps://github.com/wuxiaofei01/FastGrasp.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 40 of its 53 references that are in the map. First posted on arXiv 22 Nov 2024.

Builds on

40 of 53 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Affordance Diffusion: Synthesizing Hand-Object Interactions21 Mar

Other references · 39

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  7. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  8. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
  9. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
  10. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  11. 2022Diffusion Models already have a Semantic Latent Spacecited by 324
  12. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
27 more
  1. 2022Novel View Synthesis with Diffusion Modelscited by 299
  2. 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
  3. 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 179
  4. 2020Grasping Field: Learning Implicit Representations for Human Graspscited by 178
  5. 2021Hand-Object Contact Consistency Reasoning for Human Grasps Generationcited by 160
  6. 2019ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imagingcited by 145
  7. 2021Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Timecited by 140
  8. 2019H+O: Unified Egocentric Recognition of 3D Hand-Object Poses and Interactionscited by 139
  9. 2021ContactOpt: Optimizing Contact to Improve Graspscited by 137
  10. 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 129
  11. 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 121
  12. 2015Capturing Hands in Action using Discriminative Salient Points and Physics Simulationcited by 115
  13. 2020HOPE-Net: A Graph-based Model for Hand-Object Pose Estimationcited by 112
  14. 2021SAGA: Stochastic Whole-Body Grasping with Contactcited by 89
  15. 2019ContactGrasp: Functional Multi-finger Grasp Synthesis from Contactcited by 87
  16. 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 84
  17. 2023NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesiscited by 78
  18. 2022TOCH: Spatio-Temporal Object-to-Hand Correspondence for Motion Refinementcited by 69
  19. 2022AlignSDF: Pose-Aligned Signed Distance Fields for Hand-Object Reconstructioncited by 58
  20. 2023CAMS: CAnonicalized Manipulation Spaces for Category-Level Functional Hand-Object Manipulation Synthesiscited by 54
  21. 2023ContactGen: Generative Contact Modeling for Grasp Generationcited by 52
  22. 2021A Skeleton-Driven Neural Occupancy Representation for Articulated Handscited by 50
  23. 2023gSDF: Geometry-Driven Signed Distance Functions for 3D Hand-Object Reconstructioncited by 49
  24. 2023Task-Oriented Human-Object Interactions Generation with Implicit Neural Representationscited by 41
  25. 2023Controllable Mesh Generation Through Sparse Latent Point Diffusion Modelscited by 40
  26. 2024RealDex: Towards Human-like Grasping for Robotic Dexterous Handcited by 33
  27. 2019Forecasting Human-Object Interaction: Joint Prediction of Motor Attention and Actions in First Person Videocited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model
  2. 2024DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptions
  3. 2024ManiDext: Hand-Object Manipulation Synthesis via Continuous Correspondence Embeddings and Residual-Guided Diffusion
  4. 2024Joint Diffusion for Universal Hand-Object Grasp Generation
  5. 2026DCGrasp: Distance-aware Controllable Grasp Generation
  6. 2024Grasp Diffusion Network: Learning Grasp Generators from Partial Point Clouds with Diffusion Models in SO(3)xR3
  7. 2024Giving a Hand to Diffusion Models: a Two-Stage Approach to Improving Conditional Human Image Generation
  8. 2024NL2Contact: Natural Language Guided 3D Hand-Object Contact Modeling with Diffusion Model