LIDEA: Human-to-Robot Imitation Learning via Implicit Feature Distillation and Explicit Geometry Alignment
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
also in 1 more
Abstract (arXiv)
Scaling up robot learning is hindered by the scarcity of robotic demonstrations, whereas human videos offer a vast, untapped source of interaction data. However, bridging the embodiment gap between human hands and robot arms remains a critical challenge. Existing cross-embodiment transfer strategies typically rely on visual editing, but they often introduce visual artifacts due to intrinsic discrepancies in visual appearance and 3D geometry. To address these limitations, we introduce LIDEA (Implicit Feature Distillation and Explicit Geometric Alignment), an imitation learning framework in which policy learning benefits from human demonstrations. In the 2D visual domain, LIDEA employs a dual-stage transitive distillation pipeline that aligns human and robot representations in a shared latent space. In the 3D geometric domain, we propose an embodiment-agnostic alignment strategy that explicitly decouples embodiment from interaction geometry, ensuring consistent 3D-aware perception. Extensive experiments empirically validate LIDEA from two perspectives: data efficiency and OOD robustness. Results show that human data substitutes up to 80% of costly robot demonstrations, and the framework successfully transfers unseen patterns from human videos for out-of-distribution generalization.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 47 of its 49 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
47 of 49 references.
Closest ancestors · 8
Same direction, newest first
- 2025ZeroMimic: Distilling Robotic Manipulation Skills from Web Videos31 Mar
- 2025AirExo-2: Scaling up Generalizable Robotic Imitation Learning with Low-Cost Exoskeletons5 Mar
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulation18 Dec
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Video31 Oct
- 2024Data Scaling Laws in Imitation Learning for Robotic Manipulation24 Oct
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Play24 Feb
- 2022VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Training30 Sep
- 2021The Surprising Effectiveness of Representation Learning for Visual Imitation2 Dec
Other references · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2025DINOv3cited by 1,414
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 694
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
27 more
- 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 289
- 2022Real-World Robot Learning with Masked Visual Pre-trainingcited by 245
- 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 226
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2023LIV: Language-Image Representations and Rewards for Robotic Controlcited by 188
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 183
- 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 131
- 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videoscited by 102
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
- 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 88
- 2024OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completioncited by 82
- 2025Humanoid Policy ~ Human Policycited by 78
- 2025Phantom: Training Robots Without Robots Using Only Human Videoscited by 70
- 2024Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videoscited by 69
- 2024Theia: Distilling Diverse Vision Foundation Models for Robot Learningcited by 61
- 2025VidBot: Learning Generalizable 3D Actions from In-the-Wild 2D Human Videos for Zero-Shot Robotic Manipulationcited by 46
- 2025Masquerade: Learning from In-the-wild Human Videos using Data-Editingcited by 43
- 2025Emergence of Human to Robot Transfer in Vision-Language-Action Modelscited by 42
- 2024ViViDex: Learning Vision-based Dexterous Manipulation from Human Videoscited by 35
- 2023AR2-D2:Training a Robot Without a Robotcited by 27
- 2023SpawnNet: Learning Generalizable Visuomotor Skills from Pre-trained Networkscited by 24
- 2025H2R: A Human-to-Robot Data Augmentation for Robot Pre-training from Videoscited by 23
- 2024SAM-E: Leveraging Visual Foundation Model with Sequence Imitation for Embodied Manipulationcited by 18
- 2024CAGE: Causal Attention Enables Data-Efficient Generalizable Robotic Manipulationcited by 14
- 2024Recasting Generic Pretrained Vision Transformers As Object-Centric Scene Encoders For Manipulation Policiescited by 6
- 2024Multi-view Hand Reconstruction with a Point-Embedded Transformercited by 6
- 2025X-Diffusion: Training Diffusion Policies on Cross-Embodiment Human Demonstrationscited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Human-to-Robot Interaction: Learning from Video Demonstration for Robot Imitation
- 2025MimicDreamer: Aligning Human and Robot Demonstrations for Scalable VLA Training
- 2022K-VIL: Keypoints-based Visual Imitation Learning
- 2020A Geometric Perspective on Visual Imitation Learning
- 2026Improving Imitation Learning Efficiency for Manipulation through Geometric Prior Pretraining
- 2025EgoBridge: Domain Adaptation for Generalizable Imitation from Egocentric Human Data
- 2026Learning Transferable World-Action Models from Task-Paired Human Videos
- 2026Cross-Embodiment Transfer via Behavior-Aligned Representations