FastUMI: A Scalable and Hardware-Independent Universal Manipulation Interface with Dataset
Not on the map. Why?
Abstract (arXiv)
Real-world manipulation data involving robotic arms is crucial for developing generalist action policies, yet such data remains scarce since existing data collection methods are hindered by high costs, hardware dependencies, and complex setup requirements. In this work, we introduce FastUMI, a substantial redesign of the Universal Manipulation Interface (UMI) system that addresses these challenges by enabling rapid deployment, simplifying hardware-software integration, and delivering robust performance in real-world data acquisition. Compared with UMI, FastUMI has several advantages: 1) It adopts a decoupled hardware design and incorporates extensive mechanical modifications, removing dependencies on specialized robotic components while preserving consistent observation perspectives. 2) It also refines the algorithmic pipeline by replacing complex Visual-Inertial Odometry (VIO) implementations with an off-the-shelf tracking module, significantly reducing deployment complexity while maintaining accuracy. 3) FastUMI includes an ecosystem for data collection, verification, and integration with both established and newly developed imitation learning algorithms, accelerating policy learning advancement. Additionally, we have open-sourced a high-quality dataset of over 10,000 real-world demonstration trajectories spanning 22 everyday tasks, forming one of the most diverse UMI-like datasets to date. Experimental results confirm that FastUMI facilitates rapid deployment, reduces operational costs and labor demands, and maintains robust performance across diverse manipulation scenarios, thereby advancing scalable data-driven robotic learning.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Sep 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 7; 2026: 29.
36 papers.
Sort:
By area:
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2025Hume: Introducing System-2 Thinking in Visual-Language-Action Modelcited by 56
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2025RaC: Robot Learning for Long-Horizon Tasks by Scaling Recovery and Correctioncited by 35
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectoriescited by 24
- 2025ActiveUMI: Robotic Manipulation with Active Perception from Robot-Free Human Demonstrationscited by 17
- 2025MoMa-Kitchen: A 100K+ Benchmark for Affordance-Grounded Last-Mile Navigation in Mobile Manipulationcited by 12
- 2025Latent Policy Steering with Embodiment-Agnostic Pretrained World Modelscited by 8
- 2025Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidancecited by 7
- 2026OCRA: Object-Centric Learning with 3D and Tactile Priors for Human-to-Robot Action Transfercited by 5
- 20253D Equivariant Visuomotor Policy Learning via Spherical Projectioncited by 4
24 more
- 2026UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perceptioncited by 4
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulationcited by 4
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperationcited by 4
- 2026HandEdit: A Unified Benchmark for Egocentric Human-to-Robot Dexterous Hand Image Editingcited by 4
- 2026AoE: Always-on Egocentric Human Video Collection for Embodied AIcited by 3
- 2026Closed-Loop Action Chunks with Dynamic Corrections for Training-Free Diffusion Policycited by 3
- 2026RoboPocket: Improve Robot Policies Instantly with Your Phonecited by 3
- 2026VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Trainingcited by 2
- 2026EgoAERO: Learning Dexterous Manipulation from a Single Egocentric Video without Object Assetscited by 2
- 2026YUBI: Yielding Universal Bidigital Interface for Bimanual Dexterous Manipulation at Scalecited by 2
- 2026HiFi-UMI: Learning Deployable Manipulation Policies from High-Fidelity UMI Data Alonecited by 2
- 2026What Matters for Latent Actions in Robot Learningcited by 2
- 2026CMP: Robust Whole-Body Tracking for Loco-Manipulation via Competence Manifold Projectioncited by 1
- 2026Spatially Prompted Visual Trajectory Prediction for Egocentric Manipulationcited by 1
- 2026Sim-and-Human Co-training for Data-Efficient and Scene-Generalizable Bimanual Manipulationcited by 0
- 2026RAPID: Reconfigurable, Adaptive Platform for Iterative Designcited by 0
- 2026UMI-Underwater: Learning Underwater Manipulation without Underwater Teleoperationcited by 0
- 2026SPACE: Enabling Learning from Cross-Robot Data Toward Generalist Policiescited by 0
- 2026R3: Training Robots to Reason in Natural Language via Reinforcement Learningcited by 0
- 2026N0-Foundation: Towards the Age of Tactile Intelligencecited by 0
- 2026CosmoH2G: A Hand-to-Gripper Transfer Dataset and Baseline Method for Object Manipulation with Complex Spatial Movementscited by 0
- 2026HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interfacecited by 0
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulationcited by 0
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation29 Sep 2026
- 2026HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interface17 Sep 2026
- 2026CosmoH2G: A Hand-to-Gripper Transfer Dataset and Baseline Method for Object Manipulation with Complex Spatial Movements7 Sep 2026
- 2026N0-Foundation: Towards the Age of Tactile Intelligence30 Aug 2026
- 2026R3: Training Robots to Reason in Natural Language via Reinforcement Learning26 Aug 2026
- 2026What Matters for Latent Actions in Robot Learning20 Aug 2026
- 2026HandEdit: A Unified Benchmark for Egocentric Human-to-Robot Dexterous Hand Image Editing12 Aug 2026
- 2026Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperation3 Aug 2026
- 2026HiFi-UMI: Learning Deployable Manipulation Policies from High-Fidelity UMI Data Alone28 Jul 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectories16 Jul 2026
- 2026SPACE: Enabling Learning from Cross-Robot Data Toward Generalist Policies23 Jun 2026
24 more
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation20 Jun 2026
- 2026YUBI: Yielding Universal Bidigital Interface for Bimanual Dexterous Manipulation at Scale8 Jun 2026
- 2026EgoAERO: Learning Dexterous Manipulation from a Single Egocentric Video without Object Assets6 Jun 2026
- 2026VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Training3 Jun 2026
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
- 2026Spatially Prompted Visual Trajectory Prediction for Egocentric Manipulation19 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perception15 Apr 2026
- 2026CMP: Robust Whole-Body Tracking for Loco-Manipulation via Competence Manifold Projection8 Apr 2026
- 2026UMI-Underwater: Learning Underwater Manipulation without Underwater Teleoperation27 Mar 2026
- 2026OCRA: Object-Centric Learning with 3D and Tactile Priors for Human-to-Robot Action Transfer15 Mar 2026
- 2026RoboPocket: Improve Robot Policies Instantly with Your Phone5 Mar 2026
- 2026Closed-Loop Action Chunks with Dynamic Corrections for Training-Free Diffusion Policy2 Mar 2026
- 2026AoE: Always-on Egocentric Human Video Collection for Embodied AI27 Feb 2026
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learning11 Feb 2026
- 2026RAPID: Reconfigurable, Adaptive Platform for Iterative Design6 Feb 2026
- 2026Sim-and-Human Co-training for Data-Efficient and Scene-Generalizable Bimanual Manipulation27 Jan 2026
- 2025ActiveUMI: Robotic Manipulation with Active Perception from Robot-Free Human Demonstrations2 Oct 2025
- 2025RaC: Robot Learning for Long-Horizon Tasks by Scaling Recovery and Correction9 Sep 2025
- 2025Latent Policy Steering with Embodiment-Agnostic Pretrained World Models17 Jul 2025
- 2025Hume: Introducing System-2 Thinking in Visual-Language-Action Model27 May 2025
- 2025Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidance24 May 2025
- 20253D Equivariant Visuomotor Policy Learning via Spherical Projection22 May 2025
- 2025MoMa-Kitchen: A 100K+ Benchmark for Affordance-Grounded Last-Mile Navigation in Mobile Manipulation14 Mar 2025
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectoriescited by 24
- 2025Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidancecited by 7
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulationcited by 4
- 2026Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperationcited by 4
- 2026VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Trainingcited by 2
- 2026SPACE: Enabling Learning from Cross-Robot Data Toward Generalist Policiescited by 0
- 2026HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interfacecited by 0
- 2026HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interface17 Sep 2026
- 2026Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperation3 Aug 2026
- 2026Xiaomi-Robotics-1: Scaling Vision-Language-Action Models with over 100K Hours of Real-World Trajectories16 Jul 2026
- 2026SPACE: Enabling Learning from Cross-Robot Data Toward Generalist Policies23 Jun 2026
- 2026OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation20 Jun 2026
- 2026VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Training3 Jun 2026
- 2025Genie Centurion: Accelerating Scalable Real-World Robot Training with Human Rewind-and-Refine Guidance24 May 2025
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2025Latent Policy Steering with Embodiment-Agnostic Pretrained World Modelscited by 8
- 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2025Latent Policy Steering with Embodiment-Agnostic Pretrained World Models17 Jul 2025
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2025RaC: Robot Learning for Long-Horizon Tasks by Scaling Recovery and Correctioncited by 35
- 2025ActiveUMI: Robotic Manipulation with Active Perception from Robot-Free Human Demonstrationscited by 17
- 2025MoMa-Kitchen: A 100K+ Benchmark for Affordance-Grounded Last-Mile Navigation in Mobile Manipulationcited by 12
- 2026OCRA: Object-Centric Learning with 3D and Tactile Priors for Human-to-Robot Action Transfercited by 5
- 2026UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perceptioncited by 4
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026HandEdit: A Unified Benchmark for Egocentric Human-to-Robot Dexterous Hand Image Editingcited by 4
- 2026AoE: Always-on Egocentric Human Video Collection for Embodied AIcited by 3
- 2026EgoAERO: Learning Dexterous Manipulation from a Single Egocentric Video without Object Assetscited by 2
- 2026YUBI: Yielding Universal Bidigital Interface for Bimanual Dexterous Manipulation at Scalecited by 2
- 2026HiFi-UMI: Learning Deployable Manipulation Policies from High-Fidelity UMI Data Alonecited by 2
12 most cited of 21 All 21 (JSON)
- 2026EgoHumanoid-V2: Human-to-Humanoid Transfer of Coordinated Whole-Body Skills for Loco-Manipulation29 Sep 2026
- 2026CosmoH2G: A Hand-to-Gripper Transfer Dataset and Baseline Method for Object Manipulation with Complex Spatial Movements7 Sep 2026
- 2026N0-Foundation: Towards the Age of Tactile Intelligence30 Aug 2026
- 2026What Matters for Latent Actions in Robot Learning20 Aug 2026
- 2026HandEdit: A Unified Benchmark for Egocentric Human-to-Robot Dexterous Hand Image Editing12 Aug 2026
- 2026HiFi-UMI: Learning Deployable Manipulation Policies from High-Fidelity UMI Data Alone28 Jul 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026YUBI: Yielding Universal Bidigital Interface for Bimanual Dexterous Manipulation at Scale8 Jun 2026
- 2026EgoAERO: Learning Dexterous Manipulation from a Single Egocentric Video without Object Assets6 Jun 2026
- 2026Spatially Prompted Visual Trajectory Prediction for Egocentric Manipulation19 May 2026
- 2026UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perception15 Apr 2026
- 2026CMP: Robust Whole-Body Tracking for Loco-Manipulation via Competence Manifold Projection8 Apr 2026
12 newest of 21 All 21 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Octo: An Open-Source Generalist Robot Policy
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems
- 2025MV-UMI: A Scalable Multi-View Interface for Cross-Embodiment Learning
- 2026AXIS: A Growable Community-Driven Data Engine for Scalable Robot Manipulation
- 2026UMR: Universal Manipulation Representation ↗
- 2026MobileManiBench: Simplifying Model Verification for Mobile Manipulation
- 2025UMIGen: A Unified Framework for Egocentric Point Cloud Generation and Cross-Embodiment Robotic Imitation Learning
- 2025MOVE: A Simple Motion-Based Data Collection Paradigm for Spatial Generalization in Robotic Manipulation