GenDexHand: Generative Simulation for Dexterous Hands
Not on the map. Why?
Abstract (arXiv)
Data scarcity remains a fundamental bottleneck for embodied intelligence. Existing approaches use large language models (LLMs) to automate gripper-based simulation generation, but they transfer poorly to dexterous manipulation, which demands more specialized environment design. Meanwhile, dexterous manipulation tasks are inherently more difficult due to their higher degrees of freedom. Massively generating feasible and trainable dexterous hand tasks remains an open challenge. To this end, we present GenDexHand, a generative simulation pipeline that autonomously produces diverse robotic tasks and environments for dexterous manipulation. GenDexHand introduces a closed-loop refinement process that adjusts object placements and scales based on vision-language model (VLM) feedback, substantially improving the average quality of generated environments. Each task is further decomposed into sub-tasks to enable sequential reinforcement learning, reducing training time and increasing success rates. Our work provides a viable path toward scalable training of diverse dexterous hand behaviors in embodied intelligence by offering a simulation-based solution to synthetic data generation. Our website: https://winniechen2002.github.io/GenDexHand/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 3 Nov 2025.
Builds on
33 of 47 references.
References · 33
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 526
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
- 2024Latent Action Pretraining from Videoscited by 321
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
21 more
- 2023Scaling Robot Learning with Semantically Imagined Experiencecited by 177
- 2024RL-VLM-F: Reinforcement Learning from Vision Language Foundation Model Feedbackcited by 156
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 156
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 121
- 2022Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learningcited by 119
- 2025DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Graspingcited by 89
- 2024Learning Visuotactile Skills with Two Multifingered Handscited by 76
- 2024Twisting Lids Off with Two Handscited by 42
- 2024Hand-Object Interaction Pretraining from Videoscited by 39
- 2024GSR-BENCH: A Benchmark for Grounded Spatial Reasoning Evaluation via Multimodal LLMscited by 33
- 2020Motion Planner Augmented Reinforcement Learning for Robot Manipulation in Obstructed Environmentscited by 23
- 2024Real-World Offline Reinforcement Learning from Vision Language Model Feedbackcited by 22
- 2024Benchmarks and Metrics for Evaluations of Code Generation: A Critical Reviewcited by 20
- 2024MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understandingcited by 19
- 2025Towards Embodiment Scaling Laws in Robot Locomotioncited by 16
- 2024Robot Learning with Super-Linear Scalingcited by 11
- 2023Towards Generalist Robots: A Promising Paradigm via Generative Simulationcited by 9
- 2025From Simple to Complex Skills: The Case of In-Hand Object Reorientationcited by 8
- 2024Dexterous Functional Pre-Grasp Manipulation with Diffusion Policycited by 4
- 2024BBSEA: An Exploration of Brain-Body Synchronization for Embodied Agentscited by 3
- 2024On the Evaluation of Generative Robotic Simulationscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning
- 2025textscGen2Real: Towards Demo-Free Dexterous Manipulation by Harnessing Generated Video
- 2026DextER: Language-driven Dexterous Grasp Generation with Embodied Reasoning
- 2024RealDex: Towards Human-like Grasping for Robotic Dexterous Hand
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models
- 2026DexSim2Real: Foundation Model-Guided Sim-to-Real Transfer for Generalizable Dexterous Manipulation
- 2025EvolvingGrasp: Evolutionary Grasp Generation via Efficient Preference Alignment
- 2025ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learning