# FastGrasp: Learning-based Whole-Body Control Method for Fast Dexterous Grasping with Mobile Manipulators

arXiv: https://arxiv.org/abs/2604.12879 · HTML: https://mlsanity.com/paper/2604.12879/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 21 of its 42 references that are in the map.
- First posted on arXiv 14 Apr 2026.

## Builds on (most cited first, 21 of 21)

- [Proximal Policy Optimization Algorithms](https://mlsanity.com/paper/1707.06347/) (2017)
- [PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation](https://mlsanity.com/paper/1612.00593/) (2016)
- [Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World](https://mlsanity.com/paper/1703.06907/) (2017)
- [Learning Dexterous In-Hand Manipulation](https://mlsanity.com/paper/1808.00177/) (2018)
- [Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation](https://mlsanity.com/paper/2401.02117/) (2024)
- [DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulation](https://mlsanity.com/paper/2210.02697/) (2022)
- [UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policy](https://mlsanity.com/paper/2303.00938/) (2023)
- [GenDexGrasp: Generalizable Dexterous Grasping](https://mlsanity.com/paper/2210.00722/) (2022)
- [D(R,O) Grasp: A Unified Representation of Robot and Object Interaction for Cross-Embodiment Dexterous Grasping](https://mlsanity.com/paper/2410.01702/) (2024)
- [RealDex: Towards Human-like Grasping for Robotic Dexterous Hand](https://mlsanity.com/paper/2402.13853/) (2024)
- [Learning Dexterous Manipulation from Exemplar Object Trajectories and Pre-Grasps](https://mlsanity.com/paper/2209.11221/) (2022)
- [DexGrasp Anything: Towards Universal Robotic Dexterous Grasping with Physics Awareness](https://mlsanity.com/paper/2503.08257/) (2025)
- [BODex: Scalable and Efficient Robotic Dexterous Grasp Synthesis Using Bilevel Optimization](https://mlsanity.com/paper/2412.16490/) (2024)
- [RobustDexGrasp: Robust Dexterous Grasping of General Objects](https://mlsanity.com/paper/2504.05287/) (2025)
- [A Holistic Approach to Reactive Mobile Manipulation](https://mlsanity.com/paper/2109.04749/) (2021)
- [Catch It! Learning to Catch in Flight with Mobile Dexterous Hands](https://mlsanity.com/paper/2409.10319/) (2024)
- [DexTouch: Learning to Seek and Manipulate Objects with Tactile Dexterity](https://mlsanity.com/paper/2401.12496/) (2024)
- [DexH2R: A Benchmark for Dynamic Dexterous Grasping in Human-to-Robot Handover](https://mlsanity.com/paper/2506.23152/) (2025)
- [EvolvingGrasp: Evolutionary Grasp Generation via Efficient Preference Alignment](https://mlsanity.com/paper/2503.14329/) (2025)
- [An Architecture for Reactive Mobile Manipulation On-The-Move](https://mlsanity.com/paper/2212.06991/) (2022)
- [Reactive Base Control for On-The-Move Mobile Manipulation in Dynamic Environments](https://mlsanity.com/paper/2309.09393/) (2023)

## Abstract (arXiv)

Fast dexterous grasping while a mobile base remains in motion requires coordinated whole-body control and rapid adaptation to physical contact. We propose FastGrasp, a two-stage learning framework that integrates grasp guidance, whole-body control, and tactile feedback. First, a pretrained conditional variational autoencoder generates diverse grasp candidates from object point clouds. Candidates are filtered by approach direction and supporting-surface constraints, then ranked using an envelopment-based criterion combining grasp width and depth coverage measures. Second, a reinforcement learning policy jointly controls the mobile base, arm, and dexterous hand, using the selected grasp as guidance and tactile observations for online grasp adjustment. The policy is trained with domain randomization and deployed with command filtering and tactile-triggered grasp tightening. Simulation experiments show higher grasp success rates than the evaluated baselines under full and partial point-cloud observations, while real-world experiments demonstrate sim-to-real transfer across diverse object geometries.