OPEN TEACH: A Versatile Teleoperation System for Robotic Manipulation
Not on the map. Why?
Abstract (arXiv)
Open-sourced, user-friendly tools form the bedrock of scientific advancement across disciplines. The widespread adoption of data-driven learning has led to remarkable progress in multi-fingered dexterity, bimanual manipulation, and applications ranging from logistics to home robotics. However, existing data collection platforms are often proprietary, costly, or tailored to specific robotic morphologies. We present OPEN TEACH, a new teleoperation system leveraging VR headsets to immerse users in mixed reality for intuitive robot control. Built on the affordable Meta Quest 3, which costs 500, OPEN TEACH enables real-time control of various robots, including multi-fingered hands and bimanual arms, through an easy-to-use app. Using natural hand gestures and movements, users can manipulate robots at up to 90Hz with smooth visual feedback and interface widgets offering closeup environment views. We demonstrate the versatility of OPEN TEACH across 38 tasks on different robots. A comprehensive user study indicates significant improvement in teleoperation capability over the AnyTeleop framework. Further experiments exhibit that the collected data is compatible with policy learning on 10 dexterous and contact-rich manipulation tasks. Currently supporting Franka, xArm, Jaco, and Allegro platforms, OPEN TEACH is fully open-sourced to promote broader adoption. Videos are available at https://open-teach.github.io/.
Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Mar 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 18; 2025: 29; 2026: 24.
71 papers.
Sort:
By area:
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 145
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 128
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
- 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulationcited by 108
- 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learningcited by 77
- 2024Learning Visuotactile Skills with Two Multifingered Handscited by 76
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
- 2024SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deploymentcited by 52
- 2024Robot Utility Models: General Policies for Zero-Shot Deployment in New Environmentscited by 44
- 2024DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor Controlcited by 44
- 2024Hand-Object Interaction Pretraining from Videoscited by 39
38 more
- 2025DexWild: Dexterous Human Interactions for In-the-Wild Robot Policiescited by 38
- 2024ForceMimic: Force-Centric Imitation Learning with Force-Motion Capture System for Contact-Rich Manipulationcited by 36
- 2025BEHAVIOR Robot Suite: Streamlining Real-World Whole-Body Manipulation for Everyday Household Activitiescited by 31
- 2024Bridging the Human to Robot Dexterity Gap through Object-Oriented Rewardscited by 28
- 2025X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Realcited by 28
- 2024Lessons from Learning to Spin "Pens"cited by 26
- 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touchcited by 23
- 2024RoboMatrix: A Skill-centric Hierarchical Framework for Scalable Robot Task Planning and Execution in Open-Worldcited by 22
- 2025Dexterity from Smart Lenses: Multi-Fingered Robot Manipulation with In-the-Wild Human Demonstrationscited by 19
- 2025SAIL: Faster-than-Demonstration Execution of Imitation Learning Policiescited by 18
- 2024P3-PO: Prescriptive Point Priors for Visuo-Spatial Generalization of Robot Policiescited by 16
- 2026SimToolReal: An Object-Centric Policy for Zero-Shot Dexterous Tool Manipulationcited by 15
- 2025Touch begins where vision ends: Generalizable policies for contact-rich manipulationcited by 14
- 2024Learning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skinscited by 12
- 2025SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learningcited by 9
- 2025Scaffolding Dexterous Manipulation with Vision-Language Modelscited by 9
- 2026Dexora: Open-source VLA for High-DoF Bimanual Dexteritycited by 9
- 2025RUKA: Rethinking the Design of Humanoid Hands with Learningcited by 8
- 2025Feel the Force: Contact-Driven Learning from Humanscited by 8
- 2025XRoboToolkit: A Cross-Platform Framework for Robot Teleoperationcited by 8
- 2025Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidancecited by 7
- 2024Whole-Body Teleoperation for Mobile Manipulation at Zero Added Costcited by 6
- 2024WildLMa: Long Horizon Loco-Manipulation in the Wildcited by 6
- 2025eFlesh: Highly customizable Magnetic Touch Sensing using Cut-Cell Microstructurescited by 5
- 2026Human Universal Graspingcited by 5
- 2025Ask-to-Clarify: Resolving Instruction Ambiguity through Multi-turn Dialoguecited by 4
- 2025FieldGen: From Teleoperated Pre-Manipulation Trajectories to Field-Guided Data Generationcited by 4
- 2026SCALE: Self-uncertainty Conditioned Adaptive Looking and Execution for Vision-Language-Action Modelscited by 4
- 2026Contact-Anchored Policies: Contact Conditioning Creates Strong Robot Utility Modelscited by 4
- 2026Lucid-XR: An Extended-Reality Data Engine for Robotic Manipulationcited by 4
- 2026Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperationcited by 4
- 2025Gaze-Guided Task Decomposition for Imitation Learning in Robotic Manipulationcited by 3
- 2025MaskedManipulator: Versatile Whole-Body Manipulationcited by 3
- 2025Prepare Before You Act: Learning From Humans to Rearrange Initial Statescited by 3
- 2025IRIS: An Immersive Robot Interaction Systemcited by 2
- 2025TeleOpBench: A Simulator-Centric Benchmark for Dual-Arm Dexterous Teleoperationcited by 2
- 2025Grasp2Grasp: Vision-Based Dexterous Grasp Translation via Schr"odinger Bridgescited by 2
- 2026Sim2real Image Translation Enables Viewpoint-Robust Policies from Fixed-Camera Datasetscited by 2
50 most cited of 71 All 71 (JSON)
- 2026Steertuning Policies from a Few Human Videos13 Oct 2026
- 2026CASTER: Formalizing Zero-Shot Manipulation from Synthetic Videos as Constrained Optimization8 Oct 2026
- 2026X-Reset: Scaling Object-Centric Reinforcement Learning via Cross-Embodiment Resets28 Sep 2026
- 2026ProxiDex: Learning Dynamics-Guided Proximity Policy for Dexterous Manipulation15 Sep 2026
- 2026The Embodiment Gap in Robot Foundation Models19 Aug 2026
- 2026SpaceVLA: Spatially Grounded VLA for Robotic Manipulation with User-Authored Grasp and Place Anchors6 Aug 2026
- 2026Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperation3 Aug 2026
- 2026ModPack: Extensible Teleoperation Interface for Bimanual Mobile Manipulation21 Jul 2026
- 2026OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies4 Jul 2026
- 2026Domain Arithmetic: One-Shot VLA Adaptation under Environmental Shifts1 Jul 2026
- 2026Play2Perfect: What Matters in Dexterous Play Pretraining for Precise Assembly?24 Jun 2026
- 2026Human Universal Grasping15 Jun 2026
38 more
- 2026Mobile UMI: Cross-View Diffusion Policy with Decoupled Kinematics for Mobile Manipulation20 May 2026
- 2026Dexora: Open-source VLA for High-DoF Bimanual Dexterity18 May 2026
- 2026Lucid-XR: An Extended-Reality Data Engine for Robotic Manipulation30 Apr 2026
- 2026Ruka-v2: Tendon Driven Open-Source Dexterous Hand with Wrist and Abduction for Robot Learning27 Mar 2026
- 2026HandelBot: Real-World Piano Playing via Fast Adaptation of Dexterous Robot Policies12 Mar 2026
- 2026SimToolReal: An Object-Centric Policy for Zero-Shot Dexterous Tool Manipulation18 Feb 2026
- 2026YOR: Your Own Mobile Manipulator for Generalizable Robotics11 Feb 2026
- 2026Contact-Anchored Policies: Contact Conditioning Creates Strong Robot Utility Models9 Feb 2026
- 2026SCALE: Self-uncertainty Conditioned Adaptive Looking and Execution for Vision-Language-Action Models4 Feb 2026
- 2026Sim-and-Human Co-training for Data-Efficient and Scene-Generalizable Bimanual Manipulation27 Jan 2026
- 2026Fauna Sprout: A lightweight, approachable, developer-ready humanoid robot26 Jan 2026
- 2026Sim2real Image Translation Enables Viewpoint-Robust Policies from Fixed-Camera Datasets14 Jan 2026
- 2025Dexterity from Smart Lenses: Multi-Fingered Robot Manipulation with In-the-Wild Human Demonstrations20 Nov 2025
- 2025FieldGen: From Teleoperated Pre-Manipulation Trajectories to Field-Guided Data Generation23 Oct 2025
- 2025Prepare Before You Act: Learning From Humans to Rearrange Initial States22 Sep 2025
- 2025Tac2Motion: Contact-Aware Reinforcement Learning with Tactile Feedback for Robotic Hand Manipulation22 Sep 2025
- 2025Ask-to-Clarify: Resolving Instruction Ambiguity through Multi-turn Dialogue18 Sep 2025
- 2025LeVR: A Modular VR Teleoperation Framework for Imitation Learning in Dexterous Manipulation17 Sep 2025
- 2025XRoboToolkit: A Cross-Platform Framework for Robot Teleoperation31 Jul 2025
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos16 Jul 2025
- 2025Scaffolding Dexterous Manipulation with Vision-Language Models24 Jun 2025
- 2025Touch begins where vision ends: Generalizable policies for contact-rich manipulation16 Jun 2025
- 2025SAIL: Faster-than-Demonstration Execution of Imitation Learning Policies13 Jun 2025
- 2025eFlesh: Highly customizable Magnetic Touch Sensing using Cut-Cell Microstructures11 Jun 2025
- 2025Grasp2Grasp: Vision-Based Dexterous Grasp Translation via Schr"odinger Bridges3 Jun 2025
- 2025Feel the Force: Contact-Driven Learning from Humans2 Jun 2025
- 2025SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning28 May 2025
- 2025MaskedManipulator: Versatile Whole-Body Manipulation25 May 2025
- 2025Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidance24 May 2025
- 2025TeleOpBench: A Simulator-Centric Benchmark for Dual-Arm Dexterous Teleoperation19 May 2025
- 2025DexWild: Dexterous Human Interactions for In-the-Wild Robot Policies12 May 2025
- 2025X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Real11 May 2025
- 2025RUKA: Rethinking the Design of Humanoid Hands with Learning17 Apr 2025
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robots18 Mar 2025
- 2025AhaRobot: A Low-Cost Open-Source Bimanual Mobile Manipulator for Embodied AI13 Mar 2025
- 2025BEHAVIOR Robot Suite: Streamlining Real-World Whole-Body Manipulation for Everyday Household Activities7 Mar 2025
- 2025dARt Vinci: Egocentric Data Collection for Surgical Robot Learning at Scale7 Mar 2025
- 2025Reactive Diffusion Policy: Slow-Fast Visual-Tactile Policy Learning for Contact-Rich Manipulation4 Mar 2025
50 newest of 71 All 71 (JSON)
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 145
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learningcited by 116
- 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learningcited by 77
- 2024SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deploymentcited by 52
- 2024DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor Controlcited by 44
- 2024ForceMimic: Force-Centric Imitation Learning with Force-Motion Capture System for Contact-Rich Manipulationcited by 36
- 2025X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Realcited by 28
- 2025SAIL: Faster-than-Demonstration Execution of Imitation Learning Policiescited by 18
- 2025Touch begins where vision ends: Generalizable policies for contact-rich manipulationcited by 14
- 2025SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learningcited by 9
- 2024WildLMa: Long Horizon Loco-Manipulation in the Wildcited by 6
- 2025Gaze-Guided Task Decomposition for Imitation Learning in Robotic Manipulationcited by 3
12 most cited of 15 All 15 (JSON)
- 2025Prepare Before You Act: Learning From Humans to Rearrange Initial States22 Sep 2025
- 2025LeVR: A Modular VR Teleoperation Framework for Imitation Learning in Dexterous Manipulation17 Sep 2025
- 2025Touch begins where vision ends: Generalizable policies for contact-rich manipulation16 Jun 2025
- 2025SAIL: Faster-than-Demonstration Execution of Imitation Learning Policies13 Jun 2025
- 2025SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning28 May 2025
- 2025X-Sim: Cross-Embodiment Learning via Real-to-Sim-to-Real11 May 2025
- 2025Gaze-Guided Task Decomposition for Imitation Learning in Robotic Manipulation25 Jan 2025
- 2024WildLMa: Long Horizon Loco-Manipulation in the Wild22 Nov 2024
- 2024DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning31 Oct 2024
- 2024SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deployment24 Oct 2024
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulation24 Oct 2024
- 2024ForceMimic: Force-Centric Imitation Learning with Force-Motion Capture System for Contact-Rich Manipulation10 Oct 2024
12 newest of 15 All 15 (JSON)
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 128
- 2026Dexora: Open-source VLA for High-DoF Bimanual Dexteritycited by 9
- 2025Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidancecited by 7
- 2026Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperationcited by 4
- 2026The Embodiment Gap in Robot Foundation Modelscited by 1
- 2026Domain Arithmetic: One-Shot VLA Adaptation under Environmental Shiftscited by 0
- 2026SpaceVLA: Spatially Grounded VLA for Robotic Manipulation with User-Authored Grasp and Place Anchorscited by 0
- 2026The Embodiment Gap in Robot Foundation Models19 Aug 2026
- 2026SpaceVLA: Spatially Grounded VLA for Robotic Manipulation with User-Authored Grasp and Place Anchors6 Aug 2026
- 2026Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperation3 Aug 2026
- 2026Domain Arithmetic: One-Shot VLA Adaptation under Environmental Shifts1 Jul 2026
- 2026Dexora: Open-source VLA for High-DoF Bimanual Dexterity18 May 2026
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos16 Jul 2025
- 2025Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidance24 May 2025
- 2025Tac2Motion: Contact-Aware Reinforcement Learning with Tactile Feedback for Robotic Hand Manipulationcited by 0
- 2026HandelBot: Real-World Piano Playing via Fast Adaptation of Dexterous Robot Policiescited by 0
- 2026X-Reset: Scaling Object-Centric Reinforcement Learning via Cross-Embodiment Resetscited by 0
- 2026X-Reset: Scaling Object-Centric Reinforcement Learning via Cross-Embodiment Resets28 Sep 2026
- 2026HandelBot: Real-World Piano Playing via Fast Adaptation of Dexterous Robot Policies12 Mar 2026
- 2025Tac2Motion: Contact-Aware Reinforcement Learning with Tactile Feedback for Robotic Hand Manipulation22 Sep 2025
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2024Learning Visuotactile Skills with Two Multifingered Handscited by 76
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
- 2024Robot Utility Models: General Policies for Zero-Shot Deployment in New Environmentscited by 44
- 2024Hand-Object Interaction Pretraining from Videoscited by 39
- 2025DexWild: Dexterous Human Interactions for In-the-Wild Robot Policiescited by 38
- 2025BEHAVIOR Robot Suite: Streamlining Real-World Whole-Body Manipulation for Everyday Household Activitiescited by 31
- 2024Bridging the Human to Robot Dexterity Gap through Object-Oriented Rewardscited by 28
- 2024Lessons from Learning to Spin "Pens"cited by 26
- 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touchcited by 23
- 2024RoboMatrix: A Skill-centric Hierarchical Framework for Scalable Robot Task Planning and Execution in Open-Worldcited by 22
- 2025Dexterity from Smart Lenses: Multi-Fingered Robot Manipulation with In-the-Wild Human Demonstrationscited by 19
12 most cited of 42 All 42 (JSON)
- 2026Steertuning Policies from a Few Human Videos13 Oct 2026
- 2026CASTER: Formalizing Zero-Shot Manipulation from Synthetic Videos as Constrained Optimization8 Oct 2026
- 2026ProxiDex: Learning Dynamics-Guided Proximity Policy for Dexterous Manipulation15 Sep 2026
- 2026ModPack: Extensible Teleoperation Interface for Bimanual Mobile Manipulation21 Jul 2026
- 2026OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies4 Jul 2026
- 2026Play2Perfect: What Matters in Dexterous Play Pretraining for Precise Assembly?24 Jun 2026
- 2026Human Universal Grasping15 Jun 2026
- 2026Lucid-XR: An Extended-Reality Data Engine for Robotic Manipulation30 Apr 2026
- 2026Ruka-v2: Tendon Driven Open-Source Dexterous Hand with Wrist and Abduction for Robot Learning27 Mar 2026
- 2026SimToolReal: An Object-Centric Policy for Zero-Shot Dexterous Tool Manipulation18 Feb 2026
- 2026YOR: Your Own Mobile Manipulator for Generalizable Robotics11 Feb 2026
- 2026Contact-Anchored Policies: Contact Conditioning Creates Strong Robot Utility Models9 Feb 2026
12 newest of 42 All 42 (JSON)