mlsanityData to 7 Oct 2026

Scaling Egocentric Vision: The EPIC-KITCHENS Dataset

arXiv 1804.02748 ↗First posted 8 Apr 2018cs.CVcited by 789

Not on the map. Why?

Cited by 47 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

First-person vision is gaining interest as it offers a unique viewpoint on people's interaction with objects, their attention, and even intention. However, progress in this challenging domain has been relatively slow due to the lack of sufficiently large datasets. In this paper, we introduce EPIC-KITCHENS, a large-scale egocentric video benchmark recorded by 32 participants in their native kitchen environments. Our videos depict nonscripted daily activities: we simply asked each participant to start recording every time they entered their kitchen. Recording took place in 4 cities (in North America and Europe) by participants belonging to 10 different nationalities, resulting in highly diverse cooking styles. Our dataset features 55 hours of video consisting of 11.5M frames, which we densely labeled for a total of 39.6K action segments and 454.3K object bounding boxes. Our annotation is unique in that we had the participants narrate their own videos (after recording), thus reflecting true intention, and we crowd-sourced ground-truths based on these. We describe our object, action and anticipation challenges, and evaluate several baselines over two test splits, seen and unseen kitchens. Dataset and Project page: http://epic-kitchens.github.io

Key facts. Cited by 789 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2019: 1; 2020: 0; 2021: 82; 2022: 102; 2023: 129; 2024: 160; 2025: 170; 2026: 145.

789 papers.

Sort:

By area:

  1. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  2. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  3. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
  4. 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
  5. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  6. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  7. 2023Learning Interactive Real-World Simulatorscited by 440
  8. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
  9. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
  10. 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 310
  11. 2023Reconstructing Hands in 3D with Transformerscited by 298
  12. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
38 more
  1. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
  2. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
  3. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
  4. 2022Masked Visual Pre-training for Motor Controlcited by 246
  5. 2022Real-World Robot Learning with Masked Visual Pre-trainingcited by 241
  6. 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
  7. 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 221
  8. 2023Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?cited by 215
  9. 2021Concealed Object Detectioncited by 212
  10. 2023A Survey on Video Diffusion Modelscited by 203
  11. 2021Anticipative Video Transformercited by 197
  12. 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 195
  13. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
  14. 2022MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognitioncited by 189
  15. 2023LIV: Language-Image Representations and Rewards for Robotic Controlcited by 180
  16. 2023Aria Digital Twin: A New Benchmark Dataset for Egocentric 3D Machine Perceptioncited by 166
  17. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  18. 2024HumanPlus: Humanoid Shadowing and Imitation from Humanscited by 164
  19. 2023Language-Driven Representation Learning for Roboticscited by 163
  20. 2023Video Language Planningcited by 160
  21. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
  22. 2022Human-to-Robot Imitation in the Wildcited by 157
  23. 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 149
  24. 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
  25. 2023Structured World Models from Human Videoscited by 144
  26. 2026Advancing Open-source World Modelscited by 144
  27. 2022EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relationscited by 139
  28. 2025Magma: A Foundation Model for Multimodal AI Agentscited by 138
  29. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
  30. 2021Unidentified Video Objects: A Benchmark for Dense, Open-World Segmentationcited by 133
  31. 2025Training Agents Inside of Scalable World Modelscited by 122
  32. 2024Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulationcited by 116
  33. 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 116
  34. 2024CinePile: A Long Video Question Answering Dataset and Benchmarkcited by 112
  35. 2022Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videoscited by 110
  36. 2023Affordance Diffusion: Synthesizing Hand-Object Interactionscited by 110
  37. 2025GR-3 Technical Reportcited by 110
  38. 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 109

50 most cited of 789 All 789 (JSON)