mlsanityData to 7 Oct 2026

ActiveMimic: Egocentric Video Pretraining with Active Perception

arXiv 2606.06194 ↗First posted 4 Jun 2026cs.RO cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Egocentric human video offers a scalable alternative to robot data for pretraining, yet models pretrained on such video consistently underperform those pretrained on robot data. We attribute this gap to a missing signal, the active perception behavior in egocentric videos, where humans continuously reposition their viewpoint during manipulation, inducing camera motion that standard pipelines treat as noise. To address this, we present ActiveMimic, a pretraining framework that recovers synchronized camera and wrist trajectories from a single body-worn RGB camera, models camera motion as a viewpoint action, and jointly learns active perception and manipulation from in-the-wild egocentric human video before adapting to a target robot. Empirically, real-world experiments across tasks with diverse active perception demands show that ActiveMimic consistently surpasses baselines pretrained on human video and matches state-of-the-art models pretrained on robot data. Further analysis provides evidence that active perception capability originates from egocentric human video pretraining rather than robot-specific fine-tuning, confirming active perception as the key to unlocking egocentric human video for robot pretraining.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 53 of its 59 references that are in the map. First posted on arXiv 4 Jun 2026.

Builds on

53 of 59 references.

References · 53

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  9. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  11. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  12. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
38 more
  1. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  2. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  3. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  4. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  5. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
  6. 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
  7. 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 160
  8. 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 159
  9. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  10. 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 137
  11. 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
  12. 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 116
  13. 2016Revisiting Active Perceptioncited by 90
  14. 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
  15. 2025Humanoid Policy ~ Human Policycited by 65
  16. 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videoscited by 63
  17. 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
  18. 2026SAM 3D Body: Robust Full-Body Human Mesh Recoverycited by 61
  19. 2021Predicting the Future from First Person (Egocentric) Vision: A Surveycited by 36
  20. 2025Emergence of Human to Robot Transfer in Vision-Language-Action Modelscited by 36
  21. 2025Vision in Action: Learning Active Perception from Human Demonstrationscited by 33
  22. 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Controlcited by 32
  23. 2026Psi0: An Open Foundation Model Towards Universal Humanoid Loco-Manipulationcited by 25
  24. 2025Eye, Robot: Learning to Look to Act with a BC-RL Perception-Action Loopcited by 23
  25. 2025VisualMimic: Visual Humanoid Loco-Manipulation via Motion Tracking and Generationcited by 21
  26. 2025In-N-On: Scaling Egocentric Manipulation with in-the-wild and on-task Datacited by 21
  27. 2024Active Vision Might Be All You Need: Exploring Active Vision in Bimanual Robotic Manipulationcited by 20
  28. 2025EMMA: Scaling Mobile Manipulation via Egocentric Human Datacited by 20
  29. 2022Closed-Loop Next-Best-View Planning for Target-Driven Graspingcited by 19
  30. 2025ImMimic: Cross-Domain Imitation from Human Videos via Mapping and Interpolationcited by 19
  31. 2026EgoHumanoid: Unlocking In-the-Wild Loco-Manipulation with Robot-Free Egocentric Demonstrationcited by 18
  32. 2025ActiveUMI: Robotic Manipulation with Active Perception from Robot-Free Human Demonstrationscited by 17
  33. 2023Affordance-Driven Next-Best-View Planning for Robotic Graspingcited by 16
  34. 2022Online Next-Best-View Planner for 3D-Exploration and Inspection With a Mobile Manipulator Robotcited by 14
  35. 2025EgoMI: Learning Active Vision and Whole-Body Manipulation from Egocentric Human Demonstrationscited by 12
  36. 2025Developing Vision-Language-Action Model from Egocentric Videoscited by 10
  37. 2025Perceiving and Acting in First-Person: A Dataset and Benchmark for Egocentric Human-Object-Human Interactionscited by 7
  38. 2026SaPaVe: Towards Active Perception and Manipulation in Vision-Language-Action Models for Roboticscited by 6

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.