ForceGrip: Reference-Free Curriculum Learning for Realistic Grip Force Control in VR Hand Manipulation
Not on the map. Why?
Abstract (arXiv)
Realistic Hand manipulation is a key component of immersive virtual reality (VR), yet existing methods often rely on kinematic approach or motion-capture datasets that omit crucial physical attributes such as contact forces and finger torques. Consequently, these approaches prioritize tight, one-size-fits-all grips rather than reflecting users' intended force levels. We present ForceGrip, a deep learning agent that synthesizes realistic hand manipulation motions, faithfully reflecting the user's grip force intention. Instead of mimicking predefined motion datasets, ForceGrip uses generated training scenarios-randomizing object shapes, wrist movements, and trigger input flows-to challenge the agent with a broad spectrum of physical interactions. To effectively learn from these complex tasks, we employ a three-phase curriculum learning framework comprising Finger Positioning, Intention Adaptation, and Dynamic Stabilization. This progressive strategy ensures stable hand-object contact, adaptive force control based on user inputs, and robust handling under dynamic conditions. Additionally, a proximity reward function enhances natural finger motions and accelerates training convergence. Quantitative and qualitative evaluations reveal ForceGrip's superior force controllability and plausibility compared to state-of-the-art methods. Demo videos are available as supplementary material and the code is provided at https://han-dongheun.github.io/ForceGrip.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 71 references that are in the map. First posted on arXiv 11 Mar 2025.
Builds on
34 of 71 references.
References · 34
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
- 2017Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrationscited by 685
- 2018Learning Dexterous In-Hand Manipulationcited by 643
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
- 2021Brax -- A Differentiable Physics Engine for Large Scale Rigid Body Simulationcited by 375
- 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 350
- 2018Quantifying Generalization in Reinforcement Learningcited by 345
- 2019Emergent Tool Use From Multi-Agent Autocurriculacited by 308
- 2019On The Power of Curriculum Learning in Training Deep Networkscited by 285
- 2017Automatic Goal Generation for Reinforcement Learning Agentscited by 252
22 more
- 2017Automated Curriculum Learning for Neural Networkscited by 251
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 248
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
- 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 182
- 2017Emergence of Locomotion Behaviours in Rich Environmentscited by 159
- 2018DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skillscited by 153
- 2018Curriculum Learning by Transfer Learning: Theory and Experiments with Deep Networkscited by 113
- 2023Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learningcited by 111
- 2021D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactionscited by 109
- 2023Synthesizing Physical Character-Scene Interactionscited by 102
- 2021From Motor Control to Team Play in Simulated Humanoid Footballcited by 87
- 2018Illuminating Generalization in Deep Reinforcement Learning through Procedural Level Generationcited by 80
- 2023ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulationcited by 53
- 2023PADL: Language-Directed Physics-Based Character Controlcited by 47
- 2020UniCon: Universal Neural Controller For Physics-based Character Motioncited by 39
- 2018Learning Curriculum Policies for Reinforcement Learningcited by 34
- 2024AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agentscited by 32
- 2022Learning to Use Chopsticks in Diverse Gripping Stylescited by 29
- 2023Learning to Transfer In-Hand Manipulations Using a Greedy Shape Curriculumcited by 5
- 2023Learning a Single Policy for Diverse Behaviors on a Quadrupedal Robot using Scalable Motion Imitationcited by 3
- 2020Influence of Hand Tracking as a way of Interaction in Virtual Reality on User Experiencecited by 2
- 2019A Visually Plausible Grasping System for Object Manipulation and Interaction in Virtual Reality Environmentscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.