ActiveMimic: Egocentric Video Pretraining with Active Perception
Not on the map. Why?
Abstract (arXiv)
Egocentric human video offers a scalable alternative to robot data for pretraining, yet models pretrained on such video consistently underperform those pretrained on robot data. We attribute this gap to a missing signal, the active perception behavior in egocentric videos, where humans continuously reposition their viewpoint during manipulation, inducing camera motion that standard pipelines treat as noise. To address this, we present ActiveMimic, a pretraining framework that recovers synchronized camera and wrist trajectories from a single body-worn RGB camera, models camera motion as a viewpoint action, and jointly learns active perception and manipulation from in-the-wild egocentric human video before adapting to a target robot. Empirically, real-world experiments across tasks with diverse active perception demands show that ActiveMimic consistently surpasses baselines pretrained on human video and matches state-of-the-art models pretrained on robot data. Further analysis provides evidence that active perception capability originates from egocentric human video pretraining rather than robot-specific fine-tuning, confirming active perception as the key to unlocking egocentric human video for robot pretraining.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 53 of its 59 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
53 of 59 references.
References · 53
- 2025Qwen3 Technical Reportcited by 8,195
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
38 more
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 160
- 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 159
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 137
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 116
- 2016Revisiting Active Perceptioncited by 90
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
- 2025Humanoid Policy ~ Human Policycited by 65
- 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videoscited by 63
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
- 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 61
- 2021Predicting the Future from First Person (Egocentric) Vision: A Surveycited by 36
- 2025Emergence of Human to Robot Transfer in Vision-Language-Action Modelscited by 36
- 2025Vision in Action: Learning Active Perception from Human Demonstrationscited by 33
- 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Controlcited by 32
- 2026Psi0: An Open Foundation Model Towards Universal Humanoid Loco-Manipulationcited by 25
- 2025Eye, Robot: Learning to Look to Act with a BC-RL Perception-Action Loopcited by 23
- 2025VisualMimic: Visual Humanoid Loco-Manipulation via Motion Tracking and Generationcited by 21
- 2025In-N-On: Scaling Egocentric Manipulation with in-the-wild and on-task Datacited by 21
- 2024Active Vision Might Be All You Need: Exploring Active Vision in Bimanual Robotic Manipulationcited by 20
- 2025EMMA: Scaling Mobile Manipulation via Egocentric Human Datacited by 20
- 2022Closed-Loop Next-Best-View Planning for Target-Driven Graspingcited by 19
- 2025ImMimic: Cross-Domain Imitation from Human Videos via Mapping and Interpolationcited by 19
- 2026EgoHumanoid: Unlocking In-the-Wild Loco-Manipulation with Robot-Free Egocentric Demonstrationcited by 18
- 2025ActiveUMI: Robotic Manipulation with Active Perception from Robot-Free Human Demonstrationscited by 17
- 2023Affordance-Driven Next-Best-View Planning for Robotic Graspingcited by 16
- 2022Online Next-Best-View Planner for 3D-Exploration and Inspection With a Mobile Manipulator Robotcited by 14
- 2025EgoMI: Learning Active Vision and Whole-Body Manipulation from Egocentric Human Demonstrationscited by 12
- 2025Developing Vision-Language-Action Model from Egocentric Videoscited by 10
- 2025Perceiving and Acting in First-Person: A Dataset and Benchmark for Egocentric Human-Object-Human Interactionscited by 7
- 2026SaPaVe: Towards Active Perception and Manipulation in Vision-Language-Action Models for Roboticscited by 6
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planningcited by 3
- 2026ThinkingVLA: Interleaved Vision and Language Reasoning for Robotic Manipulationcited by 1
- 2026ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardwarecited by 0
- 2026INSPECT: Learning Robot View Selection from Assistant Usecited by 0
- 2026INSPECT: Learning Robot View Selection from Assistant Use17 Sep 2026
- 2026ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardware16 Sep 2026
- 2026MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planning15 Jul 2026
- 2026ThinkingVLA: Interleaved Vision and Language Reasoning for Robotic Manipulation16 Jun 2026