MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardware
Not on the map. Why?
Abstract (arXiv)
Vision-language-action (VLA) models have driven demand for large-scale egocentric datasets, yet the hardware and infrastructure to collect long-horizon data remain inaccessible. Datasets today typically have episodes only a few minutes long, which fails to capture the long-horizon temporal dependencies that complex robotic task execution requires. We present MobileEgo Anywhere, a framework for collecting hour-plus egocentric trajectories on commodity mobile hardware that uses modern smartphone sensors for long-term pose tracking without the hardware barriers of traditional robotics data collection. We release three components: (1) STERA, an open-source video-processing pipeline that converts raw mobile captures into standardized, training-ready formats for VLA and foundation-model research; (2) a free mobile app that lets any user record egocentric activity; and (3) a 200-hour dataset of diverse, long-form egocentric data with persistent state tracking across 584 sessions. We further show this data is a usable training signal:mid-training a VLA on it lowers held-out action-prediction error.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 21 of its 29 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
21 of 29 references.
References · 21
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2020Rescaling Egocentric Visioncited by 540
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
- 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 312
- 2022Egocentric Video-Language Pretrainingcited by 232
9 more
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 211
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 175
- 2020MediaPipe Hands: On-device Real-time Hand Trackingcited by 161
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 129
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
- 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 94
- 2025Scalable Vision-Language-Action Model Pretraining for Robotic Manipulation with Real-Life Human Activity Videoscited by 70
- 2024Aria Everyday Activities Datasetcited by 39
- 2023EgoBlur: Responsible Innovation in Ariacited by 12
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Ego-OSCAR: Egocentric Open source Stereo CAptuRe Systemcited by 1
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributescited by 0
- 2026Human Demonstrations as Post-Training Data for Any Robot Body: Retargeting the Object, Not the Handcited by 0
- 2026Human Demonstrations as Post-Training Data for Any Robot Body: Retargeting the Object, Not the Hand14 Oct 2026
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes1 Oct 2026
- 2026Ego-OSCAR: Egocentric Open source Stereo CAptuRe System8 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026ACE-Ego-0: Unifying Egocentric Human and Robotic Data for VLA Pretraining
- 2026Co-training with Ego-centric Video and Demonstration for Robot Navigation Task
- 2026Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning
- 2026Motion Focus Recognition in Fast-Moving Egocentric Video
- 2025Developing Vision-Language-Action Model from Egocentric Videos
- 2026Ego4WAM: What Matters When Scaling Egocentric Human Data for Robot Learning?
- 2026MobileManiBench: Simplifying Model Verification for Mobile Manipulation
- 2025EMMA: Scaling Mobile Manipulation via Egocentric Human Data