Aria Everyday Activities Dataset
Not on the map. Why?
Abstract (arXiv)
We present Aria Everyday Activities (AEA) Dataset, an egocentric multimodal open dataset recorded using Project Aria glasses. AEA contains 143 daily activity sequences recorded by multiple wearers in five geographically diverse indoor locations. Each of the recording contains multimodal sensor data recorded through the Project Aria glasses. In addition, AEA provides machine perception data including high frequency globally aligned 3D trajectories, scene point cloud, per-frame 3D eye gaze vector and time aligned speech transcription. In this paper, we demonstrate a few exemplar research applications enabled by this dataset, including neural scene reconstruction and prompted segmentation. AEA is an open source dataset that can be downloaded from https://www.projectaria.com/datasets/aea/. We are also providing open-source implementations and examples of how to use the dataset in Project Aria Tools https://github.com/facebookresearch/projectaria_tools.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 20 Feb 2024.
Builds on
17 of 25 references.
References · 17
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2020Rescaling Egocentric Visioncited by 529
- 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
- 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 201
5 more
- 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 187
- 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
- 2023HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real Worldcited by 159
- 2022My View is the Best View: Procedure Learning from Egocentric Videoscited by 81
- 2023EPIC Fields: Marrying 3D Geometry and Video Understandingcited by 49
Built on by
Citing papers per year: 2024: 3; 2025: 18; 2026: 17.
38 papers.
Sort:
By area:
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 101
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2024EgoLifter: Open-world 3D Segmentation for Egocentric Perceptioncited by 46
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2025Back on Track: Bundle Adjustment for Dynamic Scene Reconstructioncited by 23
- 2024EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splattingcited by 22
- 2025ST-Think: How Multimodal Large Language Models Reason About 4D Worlds from Ego-Centric Videoscited by 21
- 2025AnyCam: Learning to Recover Camera Poses and Intrinsics from Casual Videoscited by 18
- 2025DeGauss: Dynamic-Static Decomposition with Gaussian Splatting for Distractor-free 3D Reconstructioncited by 16
- 2025SAVVY: Spatial Awareness via Audio-Visual LLMs through Seeing and Hearingcited by 14
- 2025egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Taskscited by 11
26 more
- 2025LookOut: Real-World Humanoid Egocentric Navigationcited by 9
- 2024EqNIO: Subequivariant Neural Inertial Odometrycited by 8
- 2025Seeing in the Dark: Benchmarking Egocentric 3D Vision with the Oxford Day-and-Night Datasetcited by 8
- 2025EgoMe: A New Dataset and Challenge for Following Me via Egocentric View in Real Worldcited by 7
- 2025The Monado SLAM Dataset for Egocentric Visual-Inertial Trackingcited by 6
- 2025Aria Gen 2 Pilot Datasetcited by 6
- 2025EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perceptioncited by 4
- 2026OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMscited by 4
- 2025EgoCogNav: Cognition-aware Human Egocentric Navigationcited by 3
- 2026SpeechLess: Micro-utterance with Personalized Spatial Memory-aware Assistant in Everyday Augmented Realitycited by 3
- 2026EgoTL: Egocentric Think-Aloud Chains for Long-Horizon Taskscited by 3
- 2026SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memorycited by 3
- 2026MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardwarecited by 2
- 2026Personal Visual Context Learning in Large Multimodal Modelscited by 2
- 2026HandsOnWorld: Unconstrained Egocentric Video Generation with Camera-Disentangled Hand Controlcited by 2
- 2025Foveated Instance Segmentationcited by 1
- 2026DP-DeGauss: Dynamic Probabilistic Gaussian Decomposition for Egocentric 4D Scene Reconstructioncited by 1
- 2025EgoInstruct: An Egocentric Video Dataset of Face-to-face Instructional Interactions with Multi-modal LLM Benchmarkingcited by 0
- 2026Robust Egocentric Visual Attention Prediction Through Language-guided Scene Context-aware Learningcited by 0
- 2026ObjectVisA-120: Object-based Visual Attention Prediction in Interactive Street-crossing Environmentscited by 0
- 2026Learning Humanoid Navigation from Human Datacited by 0
- 2026Not Your Stereo-Typical Estimator: Combining Vision and Language for Volume Perceptioncited by 0
- 2026Ego-OSCAR: Egocentric Open source Stereo CAptuRe Systemcited by 0
- 2026Motion-Based Tokenization for Cross-Dataset Egocentric Gaze Modelingcited by 0
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalizationcited by 0
- 2026FloorSAV: Elucidating Spatial Audio-Visual Context with 2D Floormap for AV-LLMscited by 0
- 2026FloorSAV: Elucidating Spatial Audio-Visual Context with 2D Floormap for AV-LLMs8 Oct 2026
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization17 Sep 2026
- 2026Motion-Based Tokenization for Cross-Dataset Egocentric Gaze Modeling24 Aug 2026
- 2026Ego-OSCAR: Egocentric Open source Stereo CAptuRe System8 Aug 2026
- 2026HandsOnWorld: Unconstrained Egocentric Video Generation with Camera-Disentangled Hand Control2 Jul 2026
- 2026OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs2 Jun 2026
- 2026SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memory30 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026Personal Visual Context Learning in Large Multimodal Models11 May 2026
- 2026MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardware7 May 2026
- 2026Not Your Stereo-Typical Estimator: Combining Vision and Language for Volume Perception10 Apr 2026
- 2026EgoTL: Egocentric Think-Aloud Chains for Long-Horizon Tasks10 Apr 2026
26 more
- 2026DP-DeGauss: Dynamic Probabilistic Gaussian Decomposition for Egocentric 4D Scene Reconstruction9 Apr 2026
- 2026Learning Humanoid Navigation from Human Data1 Apr 2026
- 2026SpeechLess: Micro-utterance with Personalized Spatial Memory-aware Assistant in Everyday Augmented Reality31 Jan 2026
- 2026ObjectVisA-120: Object-based Visual Attention Prediction in Interactive Street-crossing Environments19 Jan 2026
- 2026Robust Egocentric Visual Attention Prediction Through Language-guided Scene Context-aware Learning5 Jan 2026
- 2025SAM 3D: 3Dfy Anything in Images20 Nov 2025
- 2025EgoCogNav: Cognition-aware Human Egocentric Navigation15 Nov 2025
- 2025Aria Gen 2 Pilot Dataset17 Oct 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025EgoInstruct: An Egocentric Video Dataset of Face-to-face Instructional Interactions with Multi-modal LLM Benchmarking26 Sep 2025
- 2025LookOut: Real-World Humanoid Egocentric Navigation20 Aug 2025
- 2025The Monado SLAM Dataset for Egocentric Visual-Inertial Tracking31 Jul 2025
- 2025EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception26 Jun 2025
- 2025SAVVY: Spatial Awareness via Audio-Visual LLMs through Seeing and Hearing4 Jun 2025
- 2025Seeing in the Dark: Benchmarking Egocentric 3D Vision with the Oxford Day-and-Night Dataset4 Jun 2025
- 2025Back on Track: Bundle Adjustment for Dynamic Scene Reconstruction20 Apr 2025
- 2025AnyCam: Learning to Recover Camera Poses and Intrinsics from Casual Videos30 Mar 2025
- 2025Foveated Instance Segmentation27 Mar 2025
- 2025DeGauss: Dynamic-Static Decomposition with Gaussian Splatting for Distractor-free 3D Reconstruction17 Mar 2025
- 2025ST-Think: How Multimodal Large Language Models Reason About 4D Worlds from Ego-Centric Videos16 Mar 2025
- 2025egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Tasks28 Feb 2025
- 2025HD-EPIC: A Highly-Detailed Egocentric Video Dataset6 Feb 2025
- 2025EgoMe: A New Dataset and Challenge for Following Me via Egocentric View in Real World31 Jan 2025
- 2024EqNIO: Subequivariant Neural Inertial Odometry12 Aug 2024
- 2024EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting28 Jun 2024
- 2024EgoLifter: Open-world 3D Segmentation for Egocentric Perception26 Mar 2024
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2026OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMscited by 4
- 2026Personal Visual Context Learning in Large Multimodal Modelscited by 2
- 2025EgoInstruct: An Egocentric Video Dataset of Face-to-face Instructional Interactions with Multi-modal LLM Benchmarkingcited by 0
- 2026OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMs2 Jun 2026
- 2026Personal Visual Context Learning in Large Multimodal Models11 May 2026
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025EgoInstruct: An Egocentric Video Dataset of Face-to-face Instructional Interactions with Multi-modal LLM Benchmarking26 Sep 2025
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2026EgoTL: Egocentric Think-Aloud Chains for Long-Horizon Taskscited by 3
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026EgoTL: Egocentric Think-Aloud Chains for Long-Horizon Tasks10 Apr 2026
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 101
- 2024EgoLifter: Open-world 3D Segmentation for Egocentric Perceptioncited by 46
- 2025Back on Track: Bundle Adjustment for Dynamic Scene Reconstructioncited by 23
- 2024EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splattingcited by 22
- 2025AnyCam: Learning to Recover Camera Poses and Intrinsics from Casual Videoscited by 18
- 2025DeGauss: Dynamic-Static Decomposition with Gaussian Splatting for Distractor-free 3D Reconstructioncited by 16
- 2025egoPPG: Heart Rate Estimation from Eye-Tracking Cameras in Egocentric Systems to Benefit Downstream Vision Taskscited by 11
- 2025LookOut: Real-World Humanoid Egocentric Navigationcited by 9
- 2024EqNIO: Subequivariant Neural Inertial Odometrycited by 8
- 2025Seeing in the Dark: Benchmarking Egocentric 3D Vision with the Oxford Day-and-Night Datasetcited by 8
- 2025The Monado SLAM Dataset for Egocentric Visual-Inertial Trackingcited by 6
12 most cited of 29 All 29 (JSON)
- 2026FloorSAV: Elucidating Spatial Audio-Visual Context with 2D Floormap for AV-LLMs8 Oct 2026
- 2026AI Smart Glasses for Wearable Intelligence: From Egocentric Sensing to Agentic Personalization17 Sep 2026
- 2026Motion-Based Tokenization for Cross-Dataset Egocentric Gaze Modeling24 Aug 2026
- 2026Ego-OSCAR: Egocentric Open source Stereo CAptuRe System8 Aug 2026
- 2026HandsOnWorld: Unconstrained Egocentric Video Generation with Camera-Disentangled Hand Control2 Jul 2026
- 2026SuperMemory-VQA: An Egocentric Visual Question-Answering Benchmark for Long-Horizon Memory30 May 2026
- 2026MobileEgo Anywhere: Open Infrastructure for long horizon egocentric data on commodity hardware7 May 2026
- 2026Not Your Stereo-Typical Estimator: Combining Vision and Language for Volume Perception10 Apr 2026
- 2026DP-DeGauss: Dynamic Probabilistic Gaussian Decomposition for Egocentric 4D Scene Reconstruction9 Apr 2026
- 2026Learning Humanoid Navigation from Human Data1 Apr 2026
- 2026SpeechLess: Micro-utterance with Personalized Spatial Memory-aware Assistant in Everyday Augmented Reality31 Jan 2026
- 2026ObjectVisA-120: Object-based Visual Attention Prediction in Interactive Street-crossing Environments19 Jan 2026
12 newest of 29 All 29 (JSON)