KPGrasp: Scalable Keypoint Flow Matching for Dexterous Grasp Generation
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Generating high-quality dexterous grasps remains challenging for learning-based methods, which often depend on carefully tuned contact losses or costly contact-based test-time refinement. We present KPGrasp, a flow-matching framework that learns dexterous grasp priors from large-scale data rather than relying on contact losses or contact-based test-time refinement. KPGrasp couples an all-Euclidean 3D hand-keypoint parameterization with a simple yet scalable Transformer flow model. The parameterization avoids the drawbacks of the conventional mixed SE(3) pose and joint-angle output space, expresses grasps in the same frame as the object point cloud, and thus enables native spatial reasoning; the Transformer flow model is trained with only the standard flow-matching loss and scales effectively with data, model capacity, and batch size. Experiments demonstrate state-of-the-art performance on two simulation benchmarks. On the Dexonomy benchmark, it reaches a 76.3% grasp success rate, improving over the strongest directly comparable baseline by 47.4% while reducing penetration depth to 2.4 mm. The same model also achieves the best average performance on the DexGrasp Anything benchmark without fine-tuning. For batched inference, KPGrasp requires only 0.032 s per grasp. Finally, real-world experiments on 20 diverse objects demonstrate that the pipeline can be deployed in a real-world setup.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 42 of its 52 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
42 of 52 references.
Closest ancestors · 5
Same direction, newest first
- 2025SE(3)-Equivariant Diffusion Policy in Spherical Fourier Space2 Jul
- 2024Learning Robotic Manipulation Policies from Point Clouds with Conditional Flow Matching11 Sep
- 2024HandDiff: 3D Hand Pose Estimation with Diffusion on Image-Point Cloud4 Apr
- 2024DexDiffuser: Generating Dexterous Grasps with Diffusion Models5 Feb
- 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenes15 Jan
Other references · 37
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
- 2025Muon is Scalable for LLM Trainingcited by 381
- 2021Hand-Object Contact Consistency Reasoning for Human Grasps Generationcited by 160
- 2023SE(3)-Stochastic Flow Matching for Protein Backbone Generationcited by 147
25 more
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 129
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
- 2025How to build a consistency model: Learning flow maps via self-distillationcited by 96
- 2020An Analysis of SVD for Deep Rotation Estimationcited by 85
- 2021Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures using Differentiable Force Closure Estimatorcited by 70
- 2022GenDexGrasp: Generalizable Dexterous Graspingcited by 54
- 2025Point Policy: Unifying Observations and Actions with Key Points for Robot Manipulationcited by 43
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 41
- 2020Deep Differentiable Grasp Planner for High-DOF Gripperscited by 39
- 2024D(R,O) Grasp: A Unified Representation of Robot and Object Interaction for Cross-Embodiment Dexterous Graspingcited by 38
- 2024RealDex: Towards Human-like Grasping for Robotic Dexterous Handcited by 33
- 2023UGG: Unified Generative Graspingcited by 30
- 2025DexGrasp Anything: Towards Universal Robotic Dexterous Grasping with Physics Awarenesscited by 25
- 2025Dex1B: Learning with 1B Demonstrations for Dexterous Manipulationcited by 23
- 2022Learning Robust Real-World Dexterous Grasping Policies via Implicit Shape Augmentationcited by 21
- 2025Dexonomy: Synthesizing All Dexterous Grasp Types in a Grasp Taxonomycited by 19
- 2025DexVLG: Dexterous Vision-Language-Grasp Model at Scalecited by 19
- 2024Dexterous Grasp Transformercited by 18
- 2024BODex: Scalable and Efficient Robotic Dexterous Grasp Synthesis Using Bilevel Optimizationcited by 18
- 2022Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wildcited by 17
- 2021HandFoldingNet: A 3D Hand Pose Estimation Network Using Multiscale-Feature Guided Folding of a 2D Hand Skeletoncited by 16
- 2025Dexterity from Smart Lenses: Multi-Fingered Robot Manipulation with In-the-Wild Human Demonstrationscited by 14
- 2023FRoGGeR: Fast Robust Grasp Generation via the Min-Weight Metriccited by 7
- 2023Task-Oriented Dexterous Hand Pose Synthesis Using Differentiable Grasp Wrench Boundary Estimatorcited by 3
- 2024FFHFlow: Diverse and Uncertainty-Aware Dexterous Grasp Generation via Flow Variational Inferencecited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DEAL-Grasp: Decoupled Alignment Representation for Geometry-Aware Dexterous Grasp Generation ↗
- 2026EquiDexFlow: Contact-Grounded SE(3)-Equivariant Dexterous Grasp Generative Flows
- 2026GraspGraphNet: Graph-Structured Multi-Embodiment Dexterous Grasp Generation ↗
- 2024DexGANGrasp: Dexterous Generative Adversarial Grasping Synthesis for Task-Oriented Manipulation
- 2025Contact Map Transfer with Conditional Diffusion Model for Generalizable Dexterous Grasp Generation
- 2025T(R,O) Grasp: Efficient Graph Diffusion of Robot-Object Spatial Transformation for Cross-Embodiment Dexterous Grasping
- 2026TOSC: Task-Oriented Shape Completion for Open-World Dexterous Grasp Generation from Partial Point Clouds ↗
- 2026DextER: Language-driven Dexterous Grasp Generation with Embodied Reasoning