mlsanityData to 7 Oct 2026

The Kinetics Human Action Video Dataset

arXiv 1705.06950 ↗First posted 19 May 2017cs.CVcited by 1,894

Not on the map. Why?

Cited by 89 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We describe the DeepMind Kinetics human action video dataset. The dataset contains 400 human action classes, with at least 400 video clips for each action. Each clip lasts around 10s and is taken from a different YouTube video. The actions are human focussed and cover a broad range of classes including human-object interactions such as playing instruments, as well as human-human interactions such as shaking hands. We describe the statistics of the dataset, how it was collected, and give some baseline performance figures for neural network architectures trained and tested for human action classification on this dataset. We also carry out a preliminary analysis of whether imbalance in the dataset leads to bias in the classifiers.

Key facts. Cited by 1,894 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 May 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 295; 2022: 388; 2023: 357; 2024: 380; 2025: 293; 2026: 181.

1,894 papers.

Sort:

By area:

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2022Video Diffusion Modelscited by 2,280
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  4. 2021ViViT: A Video Vision Transformercited by 1,610
  5. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  6. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  7. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  8. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
  9. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  10. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,162
  11. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  12. 2021Video Swin Transformercited by 1,090
38 more
  1. 2021Transformers in Vision: A Surveycited by 1,009
  2. 2022Token Merging: Your ViT But Fastercited by 995
  3. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
  4. 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
  5. 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
  6. 2023Scaling Vision Transformers to 22 Billion Parameterscited by 690
  7. 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
  8. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
  9. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  10. 2021ImageNet-21K Pretraining for the Massescited by 607
  11. 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 573
  12. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  13. 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 516
  14. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  15. 2021Less is More: ClipBERT for Video-and-Language Learning via Sparse Samplingcited by 484
  16. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
  17. 2022Masked Autoencoders As Spatiotemporal Learnerscited by 428
  18. 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 366
  19. 2021Attention Bottlenecks for Multimodal Fusioncited by 361
  20. 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
  21. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  22. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 332
  23. 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 325
  24. 2022Expanding Language-Image Pretrained Models for General Video Recognitioncited by 320
  25. 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 320
  26. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
  27. 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 310
  28. 2021Prompting Visual-Language Models for Efficient Video Understandingcited by 309
  29. 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 287
  30. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
  31. 2024MLVU: Benchmarking Multi-task Long Video Understandingcited by 275
  32. 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
  33. 2021Video Transformer Networkcited by 271
  34. 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 259
  35. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
  36. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  37. 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 251
  38. 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226

50 most cited of 1,894 All 1,894 (JSON)