TWIST2: Scalable, Portable, and Holistic Humanoid Data Collection System
Not on the map. Why?
Abstract (arXiv)
Large-scale data has driven breakthroughs in robotics, from language models to vision-language-action models in bimanual manipulation. However, humanoid robotics lacks equally effective data collection frameworks. Existing humanoid teleoperation systems either use decoupled control or depend on expensive motion capture setups. We introduce TWIST2, a portable, mocap-free humanoid teleoperation and data collection system that preserves full whole-body control while advancing scalability. Our system leverages PICO4U VR for obtaining real-time whole-body human motions, with a custom 2-DoF robot neck (cost around 250) for egocentric vision, enabling holistic human-to-humanoid control. We demonstrate long-horizon dexterous and mobile humanoid skills and we can collect 100 demonstrations in 15 minutes with an almost 100% success rate. Building on this pipeline, we propose a hierarchical visuomotor policy framework that autonomously controls the full humanoid body based on egocentric vision. Our visuomotor policy successfully demonstrates whole-body dexterous manipulation and dynamic kicking tasks. The entire system is fully reproducible and open-sourced at https://yanjieze.com/TWIST2 . Our collected dataset is also open-sourced at https://twist-data.github.io .
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). Builds on 29 of its 38 references that are in the map. First posted on arXiv 4 Nov 2025.
Builds on
29 of 38 references.
References · 29
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
- 2023Object Motion Guided Human Motion Synthesiscited by 206
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 180
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 167
- 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 137
17 more
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 86
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 72
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 65
- 2024ALOHA 2: An Enhanced Low-Cost Hardware for Bimanual Teleoperationcited by 61
- 2025Retargeting Matters: General Motion Retargeting for Humanoid Motion Trackingcited by 60
- 2025Visual Imitation Enables Contextual Humanoid Controlcited by 57
- 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 47
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Controlcited by 41
- 2024Learning Humanoid Locomotion with Perceptive Internal Modelcited by 38
- 2025CLONE: Closed-Loop Whole-Body Humanoid Teleoperation for Long-Horizon Taskscited by 35
- 2025Vision in Action: Learning Active Perception from Human Demonstrationscited by 33
- 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 32
- 2025Hand-Eye Autonomous Delivery: Learning Humanoid Navigation, Locomotion and Reachingcited by 12
- 2025ToddlerBot: Open-Source ML-Compatible Humanoid Platform for Loco-Manipulationcited by 8
- 2025XRoboToolkit: A Cross-Platform Framework for Robot Teleoperationcited by 7
- 2025Emergent Active Perception and Dexterity of Simulated Humanoids from Visual Reinforcement Learningcited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 37.
39 papers.
Sort:
By area:
- 2026World Model for Robot Learning: A Comprehensive Surveycited by 42
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matchingcited by 13
- 2025X-Humanoid: Robotize Human Videos to Generate Humanoid Videos at Scalecited by 12
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 11
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
- 2026HoloMotion-1 Technical Reportcited by 8
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulationcited by 8
- 2026SaPaVe: Towards Active Perception and Manipulation in Vision-Language-Action Models for Roboticscited by 6
- 2025CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbationcited by 5
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Datacited by 5
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperationcited by 4
27 more
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulationcited by 4
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
- 2026HAIC: Humanoid Agile Object Interaction Control via Dynamics-Aware World Modelcited by 3
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
- 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learningcited by 2
- 2026VTouch++: A Multimodal Dataset with Vision-Based Tactile Enhancement for Bimanual Manipulationcited by 2
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priorscited by 2
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenescited by 2
- 2026Scaling Behavior Foundation Model for Humanoid Robotscited by 2
- 2026DreamControl-v2: Simpler and Scalable Autonomous Humanoid Skills via Trainable Guided Diffusion Priorscited by 1
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Frameworkcited by 1
- 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitationcited by 1
- 2026ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Controlcited by 1
- 2026Fauna Sprout: A lightweight, approachable, developer-ready humanoid robotcited by 0
- 2026YOR: Your Own Mobile Manipulator for Generalizable Roboticscited by 0
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Graspingcited by 0
- 2026LadderMan: Learning Humanoid Perceptive Ladder Climbingcited by 0
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teacherscited by 0
- 2026Stubborn: A Streamlined and Unified Reinforcement Learning Framework for Robust Motion Tracking and Fall Recovery for Humanoidscited by 0
- 2026TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutescited by 0
- 2026Behavior Foundations for Quadruped Robots: ABot-C0 Technical Reportcited by 0
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmarkcited by 0
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interactioncited by 0
- 2026BRIDGE: An Open-Source Humanoid Platform via Morphology-Control Co-Design for Physical AIcited by 0
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Modelcited by 0
- 2026SocialHumanoid: Towards Expressive Humanoid Behavior via One-Step Co-Speech Motion Generationcited by 0
- 2026CoHuB: A Simulation Benchmark for Multi-Humanoid Collaborationcited by 0
- 2026CoHuB: A Simulation Benchmark for Multi-Humanoid Collaboration28 Sep 2026
- 2026SocialHumanoid: Towards Expressive Humanoid Behavior via One-Step Co-Speech Motion Generation27 Sep 2026
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model8 Sep 2026
- 2026BRIDGE: An Open-Source Humanoid Platform via Morphology-Control Co-Design for Physical AI3 Sep 2026
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interaction18 Aug 2026
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark13 Aug 2026
- 2026Scaling Behavior Foundation Model for Humanoid Robots16 Jul 2026
- 2026Behavior Foundations for Quadruped Robots: ABot-C0 Technical Report8 Jul 2026
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes29 Jun 2026
- 2026ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Control29 Jun 2026
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interaction25 Jun 2026
- 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation25 Jun 2026
27 more
- 2026TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutes24 Jun 2026
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation20 Jun 2026
- 2026Stubborn: A Streamlined and Unified Reinforcement Learning Framework for Robust Motion Tracking and Fall Recovery for Humanoids11 Jun 2026
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation8 Jun 2026
- 2026HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers4 Jun 2026
- 2026LadderMan: Learning Humanoid Perceptive Ladder Climbing4 Jun 2026
- 2026Imagine2Real: Towards Zero-shot Humanoid-Object Interaction via Video Generative Priors21 May 2026
- 2026SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework19 May 2026
- 2026HoloMotion-1 Technical Report14 May 2026
- 2026World Model for Robot Learning: A Comprehensive Survey30 Apr 2026
- 2026VTouch++: A Multimodal Dataset with Vision-Based Tactile Enhancement for Bimanual Manipulation22 Apr 2026
- 2026DreamControl-v2: Simpler and Scalable Autonomous Humanoid Skills via Trainable Guided Diffusion Priors31 Mar 2026
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gating25 Mar 2026
- 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learning14 Mar 2026
- 2026SaPaVe: Towards Active Perception and Manipulation in Vision-Language-Action Models for Robotics12 Mar 2026
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Data10 Mar 2026
- 2026HERO: Learning Humanoid End-Effector Control for Visual Whole-Body Open-Vocabulary Object Grasping18 Feb 2026
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching17 Feb 2026
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperation13 Feb 2026
- 2026HAIC: Humanoid Agile Object Interaction Control via Dynamics-Aware World Model12 Feb 2026
- 2026YOR: Your Own Mobile Manipulator for Generalizable Robotics11 Feb 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control7 Feb 2026
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrations6 Feb 2026
- 2026Fauna Sprout: A lightweight, approachable, developer-ready humanoid robot26 Jan 2026
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructions19 Jan 2026
- 2025CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbation16 Dec 2025
- 2025X-Humanoid: Robotize Human Videos to Generate Humanoid Videos at Scale4 Dec 2025
- 2026World Model for Robot Learning: A Comprehensive Surveycited by 42
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulationcited by 8
- 2026HAIC: Humanoid Agile Object Interaction Control via Dynamics-Aware World Modelcited by 3
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interactioncited by 0
- 2026GigaBrain-WBC-0.5: A Behavior World Model for Robust Humanoid Whole-Body Tracking with Environment Interaction18 Aug 2026
- 2026MotionWAM: Towards Foundation World Action Models for Real-Time Humanoid Loco-Manipulation8 Jun 2026
- 2026World Model for Robot Learning: A Comprehensive Survey30 Apr 2026
- 2026HAIC: Humanoid Agile Object Interaction Control via Dynamics-Aware World Model12 Feb 2026
- 2026TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Controlcited by 14
- 2026Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matchingcited by 13
- 2025X-Humanoid: Robotize Human Videos to Generate Humanoid Videos at Scalecited by 12
- 2026Humanoid Manipulation Interface: Humanoid Whole-Body Manipulation from Robot-Free Demonstrationscited by 11
- 2026FRoM-W1: Towards General Humanoid Whole-Body Control with Language Instructionscited by 10
- 2026HoloMotion-1 Technical Reportcited by 8
- 2025CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbationcited by 5
- 2026ZeroWBC: Learning Natural Whole-Body Humanoid Interaction from Human Egocentric Datacited by 5
- 2026CLOT: Closed-Loop Global Motion Tracking for Whole-Body Humanoid Teleoperationcited by 4
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interactioncited by 4
- 2026SafeFlow: Real-Time Text-Driven Humanoid Whole-Body Control via Physics-Guided Rectified Flow and Selective Safety Gatingcited by 3
- 2026VTouch++: A Multimodal Dataset with Vision-Based Tactile Enhancement for Bimanual Manipulationcited by 2
12 most cited of 30 All 30 (JSON)
- 2026CoHuB: A Simulation Benchmark for Multi-Humanoid Collaboration28 Sep 2026
- 2026SocialHumanoid: Towards Expressive Humanoid Behavior via One-Step Co-Speech Motion Generation27 Sep 2026
- 2026TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model8 Sep 2026
- 2026BRIDGE: An Open-Source Humanoid Platform via Morphology-Control Co-Design for Physical AI3 Sep 2026
- 2026HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark13 Aug 2026
- 2026Scaling Behavior Foundation Model for Humanoid Robots16 Jul 2026
- 2026Behavior Foundations for Quadruped Robots: ABot-C0 Technical Report8 Jul 2026
- 2026VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes29 Jun 2026
- 2026ReactiveBFM: Reactive Closed-Loop Motion Planning Towards Universal Humanoid Whole-Body Control29 Jun 2026
- 2026SceneBot: Contact-Prompted General Humanoid Whole Body Tracking with Scene-Interaction25 Jun 2026
- 2026PressMimic: Pressure-Guided Motion Capture and Control for Humanoid Robot Imitation25 Jun 2026
- 2026TaskNPoint: How to Teach Your Humanoid to Hit a Backhand in Minutes24 Jun 2026
12 newest of 30 All 30 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026HumDex: Humanoid Dexterous Manipulation Made Easy
- 2026Towards a General Humanoid Loco-Manipulation Model via Egocentric Whole-Body Human Data Pretraining ↗
- 2025Coordinated Humanoid Manipulation with Choice Policies
- 2026OmniClone: Engineering a Robust, All-Rounder Whole-Body Humanoid Teleoperation System ↗
- 2026SIMPLE: Simulation-Based Policy Learning and Evaluation for Humanoid Loco-manipulation
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation
- 2026EgoHumanoid: Unlocking In-the-Wild Loco-Manipulation with Robot-Free Egocentric Demonstration
- 2024Generalizable Humanoid Manipulation with 3D Diffusion Policies