DexFLEX: Contact-Aware Foundation Controller for Command-Guided Dexterity
Not on the map. Why?
Abstract (arXiv)
Dexterous robot hands can receive useful motion intent from teleoperation or learned policies, but successful execution also depends on contact decisions that these commands rarely specify. We introduce DexFLEX, a contact-aware foundation controller that turns upstream fingertip-motion drafts into contact-consistent joint commands. Instead of treating a draft as a trajectory to copy, DexFLEX treats it as evidence about intent: from the current tactile-proprioceptive state, it proposes feasible short-horizon motion chunks, predicts their contact consequences, and selects the candidate that best follows the command while preserving future contact stability. At inference time, a simple Draft-Dream-Select procedure combines pure-prior proposals for recovery with draft-seeded proposals for responsiveness, then decodes the selected motion into executable joint-space targets. Across degraded-command simulation, real-world shared control, and visuomotor policy learning, the same trained controller improves robustness without retraining, increasing real-world teleoperation success from 29.2% to 78.3% and reaching 46.7% policy-learning success, 3.5 times direct joint-action prediction, and 1.56 times prior-only correction. Videos are available at dex-flex.github.io.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 38 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
30 of 38 references.
References · 30
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 160
- 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 124
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
- 2019DexPilot: Vision Based Teleoperation of Dexterous Robotic Hand-Arm Systemcited by 114
- 2023General In-Hand Object Rotation with Vision and Touchcited by 99
- 2019Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Taskscited by 84
- 2023Rotating without Seeing: Towards In-hand Dexterity through Touchcited by 84
18 more
- 2024Learning Visuotactile Skills with Two Multifingered Handscited by 76
- 20243D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensingcited by 72
- 2018Shared Autonomy via Deep Reinforcement Learningcited by 66
- 2023Dexterity from Touch: Self-Supervised Pre-Training of Tactile Representations with Robotic Playcited by 62
- 2025ManiFlow: A General Robot Manipulation Policy via Consistency Flow Trainingcited by 49
- 2017Shared Autonomy via Hindsight Optimization for Teleoperation and Teamingcited by 40
- 2026OmniVTA: Visuo-Tactile World Modeling for Contact-Rich Robotic Manipulationcited by 36
- 2025SPIDER: Scalable Physics-Informed Dexterous Retargetingcited by 32
- 2025DexterityGen: Foundation Controller for Unprecedented Dexteritycited by 29
- 2026Visuo-Tactile World Modelscited by 29
- 2020Residual Policy Learning for Shared Autonomycited by 26
- 2023To the Noise and Back: Diffusion for Shared Autonomycited by 22
- 2025Learning to Feel the Future: DreamTacVLA for Contact-Rich Manipulationcited by 18
- 2026VTAM: Video-Tactile-Action Models for Complex Physical Interaction Beyond VLAscited by 17
- 2026SimToolReal: An Object-Centric Policy for Zero-Shot Dexterous Tool Manipulationcited by 15
- 2026FlexiTac: A Low-Cost, Open-Source, Scalable Tactile Sensing Solution for Robotic Systemscited by 6
- 2025LodeStar: Long-horizon Dexterity via Synthetic Data Augmentation from Human Demonstrationscited by 4
- 2026Learning Versatile Humanoid Manipulation with Touch Dreamingcited by 4
Built on by
Not cited yet.