RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotion
Not on the map. Why?
Abstract (arXiv)
Humans learn locomotion through visual observation, interpreting visual content first before imitating actions. However, state-of-the-art humanoid locomotion systems rely on either curated motion capture trajectories or sparse text commands, leaving a critical gap between visual understanding and control. Text-to-motion methods suffer from semantic sparsity and staged pipeline errors, while video-based approaches only perform mechanical pose mimicry without genuine visual understanding. We propose RoboMirror, the first retargeting-free video-to-locomotion framework embodying "understand before you imitate". Leveraging VLMs, it distills raw egocentric/third-person videos into visual motion intents, which directly condition a diffusion-based policy to generate physically plausible, semantically aligned locomotion without explicit pose reconstruction or retargeting. Extensive experiments validate the effectiveness of RoboMirror, it enables telepresence via egocentric videos, drastically reduces third-person control latency by 80%, and achieves a 3.7% higher task success rate than baselines. By reframing humanoid control around video understanding, we bridge the visual understanding and action gap.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 45 of its 62 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
45 of 62 references.
References · 45
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 400
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 359
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
33 more
- 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 218
- 2024OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learningcited by 189
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
- 2025ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skillscited by 130
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 127
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 114
- 2025TWIST: Teleoperated Whole-Body Imitation Systemcited by 101
- 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 88
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 83
- 2025Retargeting Matters: General Motion Retargeting for Humanoid Motion Trackingcited by 75
- 2024LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioningcited by 59
- 2024Humanoid-Gym: Reinforcement Learning for Humanoid Robot with Zero-Shot Sim2Real Transfercited by 53
- 2025KungfuBot: Physics-Based Humanoid Whole-Body Control for Learning Highly-Dynamic Skillscited by 52
- 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 46
- 2025BeamDojo: Learning Agile Humanoid Locomotion on Sparse Footholdscited by 46
- 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instructioncited by 43
- 2025FALCON: Learning Force-Adaptive Humanoid Loco-Manipulationcited by 40
- 2025CLONE: Closed-Loop Whole-Body Humanoid Teleoperation for Long-Horizon Taskscited by 38
- 2025HDMI: Learning Interactive Humanoid Whole-Body Control from Human Videoscited by 38
- 2025UniTracker: Learning Universal Whole-Body Motion Tracker for Humanoid Robotscited by 37
- 2023Robust and Versatile Bipedal Jumping Control through Reinforcement Learningcited by 36
- 2025HITTER: A HumanoId Table TEnnis Robot via Hierarchical Planning and Learningcited by 33
- 2025HuB: Learning Extreme Humanoid Balancecited by 28
- 2025Learning Getting-Up Policies for Real-World Humanoid Robotscited by 26
- 2025LangWBC: Language-directed Humanoid Whole-Body Control via End-to-end Learningcited by 22
- 2025From Language to Locomotion: Retargeting-free Humanoid Control via Motion Latent Guidancecited by 18
- 2022Learning and Deploying Robust Locomotion Policies with Minimal Dynamics Randomizationcited by 17
- 2025From Experts to a Generalist: Toward General Whole-Body Control for Humanoid Robotscited by 17
- 2025KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Controlcited by 13
- 2025Hold My Beer: Learning Gentle Humanoid Locomotion and End-Effector Stabilization Controlcited by 12
- 2025RL from Physical Feedback: Aligning Large Motion Models with Humanoid Controlcited by 11
- 2024ViMo: Generating Motions from Casual Videoscited by 3
- 2025OmniMotion: Multimodal Motion Generation with Continuous Masked Autoregressioncited by 3
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
- 2026VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Modelcited by 9
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulationcited by 6
- 2026Robot Learning from Human Videos: A Surveycited by 5
- 2026Action-Sketcher: From Reasoning to Action via Visual Sketches for Long-Horizon Robotic Manipulationcited by 4
- 2026Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recoverycited by 4
- 2026Track-and-Complete: Learning Humanoid Skills from a Single Failed Human Videocited by 0
- 2026Track-and-Complete: Learning Humanoid Skills from a Single Failed Human Video29 Sep 2026
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation6 Aug 2026
- 2026VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model2 May 2026
- 2026Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery2 May 2026
- 2026Robot Learning from Human Videos: A Survey30 Apr 2026
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulation9 Apr 2026
- 2026Action-Sketcher: From Reasoning to Action via Visual Sketches for Long-Horizon Robotic Manipulation4 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Being-M0.7: A Latent World-Action Model for Humanoid Robots
- 2026Learning Reusable Hybrid Motion Priors for Humanoid Locomotion from Motion Imitation
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs
- 2026FetchMan: Learning Visual Humanoid Loco-Manipulation Policies from Simulated Experiences
- 2025NIL: No-data Imitation Learning by Leveraging Pre-trained Video Diffusion Models
- 2024I-CTRL: Imitation to Control Humanoid Robots Through Constrained Reinforcement Learning
- 2025A Scalable Whole-body Motion Transfer via Implicit Kinodynamic Motion Retargeting
- 2026EgoHumanoid: Unlocking In-the-Wild Loco-Manipulation with Robot-Free Egocentric Demonstration