Simulation-Driven Imitation Learning for Biosignals-Free Shared-Autonomy Prosthetic Grasping
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
Biosignals-free shared-autonomy control of upper-limb prosthetic hands aims to enable natural and low-effort manipulation without relying on EMG or other physiological signals. Recent imitation-learning-based approaches have shown promising results, but their scalability is limited by the cost and variability of collecting large amounts of real-world human demonstration data. In this work, we present a scalable simulation framework that automatically generates diverse reach-to-grasp demonstrations from a wrist-mounted virtual camera. The framework combines physically feasible grasp synthesis, natural reaching trajectories retargeting, and reach--grasp--lift execution in procedurally generated indoor environments. It records wrist-view observations, proprioception, and actions to build a large-scale demonstration dataset for imitation learning. Through extensive simulation benchmarks, we evaluate object and scene generalization and compare several representative state-of-the-art imitation learning methods. Results show that the simulated demonstrations are sufficiently rich and consistent for effective policy learning. In three realistic settings, the learned sim-to-real policy achieves over 90% grasp success, surpasses baseline methods, and exhibits stronger generalization, highlighting the promise of simulation-driven training for biosignals-free shared-autonomy prosthetic grasping. The demonstrations are available at hrefhttps://sites.google.com/view/sim-prosthetic-grasp/homehttps://sites.google.com/view/sim-prosthetic-grasp/home.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 29 of its 64 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
29 of 64 references.
Closest ancestors · 3
Same direction, newest first
- 2025HannesImitation: Grasping with the Hannes Prosthetic Hand via Imitation Learning1 Aug
- 2023Human-in-the-Loop Task and Motion Planning for Imitation Learning24 Oct
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware23 Apr
Other references · 26
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2015End-to-End Training of Deep Visuomotor Policiescited by 875
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2018Behavioral Cloning from Observationcited by 492
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
- 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 266
- 2021Contact-GraspNet: Efficient 6-DoF Grasp Generation in Cluttered Scenescited by 218
- 2018Sim-to-Real via Sim-to-Sim: Data-efficient Robotic Grasping via Randomized-to-Canonical Adaptation Networkscited by 174
- 2023A Survey of Imitation Learning: Algorithms, Recent Developments, and Challengescited by 148
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 137
- 2024Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generationcited by 137
14 more
- 2018Robot Learning in Homes: Improving Generalization and Reducing Dataset Biascited by 75
- 2025Residual Off-Policy RL for Finetuning Behavior Cloning Policiescited by 55
- 2022Vision-Based Manipulators Need to Also See from Their Handscited by 47
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 44
- 2017Domain Randomization and Generative Models for Robotic Graspingcited by 36
- 2017Data-driven Planning via Imitation Learningcited by 36
- 2023GraspGF: Learning Score-based Grasping Primitive for Human-assisting Dexterous Graspingcited by 23
- 2024BODex: Scalable and Efficient Robotic Dexterous Grasp Synthesis Using Bilevel Optimizationcited by 20
- 2024MultiGripperGrasp: A Dataset for Robotic Grasping from Parallel Jaw Grippers to Dexterous Handscited by 16
- 2023Domain Randomization for Sim2real Transfer of Automatically Generated Grasping Datasetscited by 9
- 2018Proprioceptive Sonomyographic Control: A novel method of intuitive proportional control of multiple degrees of freedom for upper-extremity amputeescited by 3
- 2024A Powered Prosthetic Hand with Vision System for Enhancing the Anthropopathic Graspcited by 3
- 2025Bring Your Own Grasp Generator: Leveraging Robot Grasp Generation for Prosthetic Graspingcited by 2
- 2025Towards Biosignals-Free Autonomous Prosthetic Hand Control via Imitation Learningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Closing the Reality Gap: Zero-Shot Sim-to-Real Deployment for Dexterous Force-Based Grasping and Manipulation ↗
- 2026UniDex-ViTac: Learning Unified Visuo-Tactile Dexterous Manipulation Policy from Human Video Data ↗
- 2026Closing the Reality Gap: Zero-Shot Sim-to-Real Deployment for Dexterous Force-Based Grasping and Manipulation
- 2022From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperation
- 2024Sampling-Based Model Predictive Control for Dexterous Manipulation on a Biomimetic Tendon-Driven Hand
- 2026GraspLDP: Towards Generalizable Grasping Policy via Latent Diffusion
- 2024Cross-Embodiment Dexterous Grasping with Reinforcement Learning
- 2026PTLD: Sim-to-real Privileged Tactile Latent Distillation for Dexterous Manipulation