mlsanityData to 7 Oct 2026

Bench2Dex: Benchmarking Visuo-Tactile Bimanual Dexterous Manipulation Across Dexterous Hands

arXiv 2609.15726 ↗First posted 14 Sep 2026cs.RO cs.AI cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Tactile sensing provides contact information that can be difficult to infer from vision alone, but tactile hardware for dexterous hands has not converged to a common design. Dexterous hands differ in finger structure, contact surfaces, and sensor layouts, while simulated tactile signals still differ from measurements produced by physical sensors. These factors make it difficult to study visuo-tactile manipulation across diverse dexterous hands within a consistent experimental setting. We present Bench2Dex, a simulation benchmark for visuo-tactile bimanual manipulation across 12 dexterous hands. We adapt existing robot models with a shared simulated tactile interface that converts local contact geometry into image-like tactile observations. The interface provides a consistent observation format across different hand morphologies without attempting to reproduce the output of a specific physical tactile sensor. Bench2Dex includes 26 bimanual manipulation tasks that involve tool use, articulated-object interaction, and multi-stage manipulation, together with about 1.3K human-teleoperated demonstrations. The benchmark provides synchronized visual, tactile, proprioceptive, action, and object-state observations, together with executable task metrics. For robustness, we group seven perturbation types into invariance axis, where the correct action does not change, and equivariance axis, where the correct action changes together with the perturbation. We evaluate ACT, Diffusion Policy, pi0.5, and GR00T N1.5 on Bench2Dex and report their performance and failure modes. Bench2Dex is meant as a platform for studying visuo-tactile learning across dexterous hands. It does not assume that simulated tactile observations can replace real tactile sensing; it offers a shared setting for algorithm development while tactile hardware and simulation models are still evolving.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 67 of its 77 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

67 of 77 references.

References · 67

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  6. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  7. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
  8. 2017Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrationscited by 685
  9. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  10. 2018Learning Dexterous In-Hand Manipulationcited by 643
  11. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  12. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
38 more
  1. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  2. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  3. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
  4. 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
  5. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
  6. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
  7. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
  8. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
  9. 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
  10. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  11. 2020DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulationcited by 164
  12. 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 140
  13. 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 136
  14. 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 129
  15. 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
  16. 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
  17. 2022Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learningcited by 113
  18. 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 104
  19. 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 103
  20. 2022From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperationcited by 79
  21. 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 67
  22. 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
  23. 2023DexArt: Benchmarking Generalizable Dexterous Manipulation with Articulated Objectscited by 64
  24. 2024Sparsh: Self-supervised touch representations for vision-based tactile sensingcited by 61
  25. 2020TACTO: A Fast, Flexible, and Open-source Simulator for High-Resolution Vision-based Tactile Sensorscited by 59
  26. 2025TLA: Tactile-Language-Action Model for Contact-Rich Manipulationcited by 46
  27. 2021Tactile-RL for Insertion: Generalization to Objects of Unknown Geometrycited by 45
  28. 2021Taxim: An Example-based Simulation Model for GelSight Tactile Sensorscited by 42
  29. 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 41
  30. 2024PerAct2: Benchmarking and Learning for Robotic Bimanual Manipulation Taskscited by 37
  31. 2024Towards Generalizable Vision-Language Robotic Manipulation: A Benchmark and LLM-guided 3D Policycited by 37
  32. 2019Manipulation by Feel: Touch-Based Control with Deep Predictive Modelscited by 34
  33. 2017Improved GelSight Tactile Sensor for Measuring Geometry and Slipcited by 27
  34. 2023The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learningcited by 24
  35. 2024TacDiffusion: Force-domain Diffusion Policy for Precise Tactile Manipulationcited by 23
  36. 2025Dex1B: Learning with 1B Demonstrations for Dexterous Manipulationcited by 23
  37. 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touchcited by 22
  38. 2026TacVLA: Contact-Aware Tactile Fusion for Robust Vision-Language-Action Manipulationcited by 17

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Spatially anchored Tactile Awareness for Robust Dexterous Manipulation
  2. 2026DexTacWAM: A Visuo-Tactile World-Action Model for Dexterous Manipulation
  3. 2026UniVTAC: A Unified Simulation Platform for Visuo-Tactile Manipulation Data Generation, Learning, and Benchmarking
  4. 2026TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation
  5. 2026ContactWorld: What Representations Matter for Vision-Tactile Latent World Models in Contact-Rich Manipulation
  6. 2026ViTacWorld: Scaling Visuo-Tactile World Models for Contact-Rich Robot Manipulation
  7. 2026TacO: Benchmarking Tactile Sensors for Object Manipulation
  8. 2025ViTacFormer: Learning Cross-Modal Representation for Visuo-Tactile Dexterous Manipulation