XRoboToolkit: A Cross-Platform Framework for Robot Teleoperation
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of Vision-Language-Action models has created an urgent need for large-scale, high-quality robot demonstration datasets. Although teleoperation is the predominant method for data collection, current approaches suffer from limited scalability, complex setup procedures, and suboptimal data quality. This paper presents XRoboToolkit, a cross-platform framework for extended reality based robot teleoperation built on the OpenXR standard. The system features low-latency stereoscopic visual feedback, optimization-based inverse kinematics, and support for diverse tracking modalities including head, controller, hand, and auxiliary motion trackers. XRoboToolkit's modular architecture enables seamless integration across robotic platforms and simulation environments, spanning precision manipulators, mobile robots, and dexterous hands. We demonstrate the framework's effectiveness through precision manipulation tasks and validate data quality by training VLA models that exhibit robust autonomous performance.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 31 Jul 2025.
Builds on
14 of 26 references.
References · 14
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 145
- 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 101
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challengescited by 74
- 2024OPEN TEACH: A Versatile Teleoperation System for Robotic Manipulationcited by 71
- 2023Deep Imitation Learning for Humanoid Loco-manipulation through Human Teleoperationcited by 54
- 2025RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learningcited by 54
- 2024Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrationscited by 35
- 2023Teleoperation of Humanoid Robots: A Surveycited by 34
Built on by
Citing papers per year: 2025: 3; 2026: 5.
8 papers.
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 101
- 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 76
- 2025TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection Systemcited by 44
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulationcited by 10
- 2025End-to-End Dexterous Arm-Hand VLA Policies via Shared Autonomy: VR Teleoperation Augmented by Autonomous Hand VLA Policy for Efficient Data Collectioncited by 9
- 2026EgoKit: Towards Unified Low-Cost Egocentric Data Collection with Heterogeneous Devicescited by 1
- 2026Reality Copilot: Voice-First Human-AI Collaboration in Mixed Reality Using Large Multimodal Modelscited by 0
- 2026Constrained Whole-Body Tracking for Humanoid Robotscited by 0
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation8 Jun 2026
- 2026Constrained Whole-Body Tracking for Humanoid Robots29 May 2026
- 2026EgoKit: Towards Unified Low-Cost Egocentric Data Collection with Heterogeneous Devices16 May 2026
- 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Control11 Mar 2026
- 2026Reality Copilot: Voice-First Human-AI Collaboration in Mixed Reality Using Large Multimodal Models11 Feb 2026
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Control11 Nov 2025
- 2025TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection System4 Nov 2025
- 2025End-to-End Dexterous Arm-Hand VLA Policies via Shared Autonomy: VR Teleoperation Augmented by Autonomous Hand VLA Policy for Efficient Data Collection31 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Phone2Act: A Low-Cost, Hardware-Agnostic Teleoperation System for Scalable VLA Data Collection
- 2025LeVR: A Modular VR Teleoperation Framework for Imitation Learning in Dexterous Manipulation
- 2026MobileManiBench: Simplifying Model Verification for Mobile Manipulation
- 2026RIO: Flexible Real-Time Robot I/O for Cross-Embodiment Robot Learning
- 2026A Sim-to-Real Integration Pipeline for Training and Deployment of Chunk-Based VLA Manipulation Policies
- 2025Control Your Robot: A Unified System for Robot Control and Policy Deployment ↗
- 2025Open TeleDex: A Hardware-Agnostic Teleoperation System for Imitation Learning based Dexterous Manipulation
- 2024TelePreview: A User-Friendly Teleoperation System with Virtual Arm Assistance for Enhanced Effectiveness ↗