A Short Note on the Kinetics-700 Human Action Dataset
Not on the map. Why?
Cited by 21 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We describe an extension of the DeepMind Kinetics human action dataset from 600 classes to 700 classes, where for each class there are at least 600 video clips from different YouTube videos. This paper details the changes introduced for this new release of the dataset, and includes a comprehensive set of statistics as well as baseline results using the I3D neural network architecture.
Key facts. Cited by 308 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 47; 2022: 57; 2023: 48; 2024: 58; 2025: 70; 2026: 28.
308 papers.
Sort:
By area:
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2021Transformers in Vision: A Surveycited by 1,009
- 2021Multiscale Vision Transformerscited by 896
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 573
- 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 516
38 more
- 2021Less is More: ClipBERT for Video-and-Language Learning via Sparse Samplingcited by 484
- 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 441
- 2021SLIP: Self-supervision meets Language-Image Pre-trainingcited by 434
- 2022Masked Autoencoders As Spatiotemporal Learnerscited by 428
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 377
- 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 325
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 310
- 2021Prompting Visual-Language Models for Efficient Video Understandingcited by 309
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 287
- 2022What does a platypus look like? Generating customized prompts for zero-shot image classificationcited by 263
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 220
- 2021A Large-Scale Study on Unsupervised Spatiotemporal Representation Learningcited by 214
- 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
- 2023Video Understanding with Large Language Models: A Surveycited by 203
- 2023Unmasked Teacher: Towards Training-Efficient Video Foundation Modelscited by 199
- 2022ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learningcited by 192
- 2022MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognitioncited by 189
- 2021Towards Long-Form Video Understandingcited by 146
- 2023AIM: Adapting Image Models for Efficient Video Action Recognitioncited by 145
- 2025Magma: A Foundation Model for Multimodal AI Agentscited by 138
- 2021MoViNets: Mobile Video Networks for Efficient Video Recognitioncited by 135
- 2022UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormercited by 116
- 2022HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modelingcited by 115
- 2021VidTr: Video Transformer Without Convolutionscited by 112
- 2025VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documentscited by 110
- 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 104
- 2024EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameterscited by 99
- 2023Concept-based Explainable Artificial Intelligence: A Surveycited by 97
- 2022Temporal Action Segmentation: An Analysis of Modern Techniquescited by 85
- 2023MM-VID: Advancing Video Understanding with GPT-4V(ision)cited by 82
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2022Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervisioncited by 80
- 2022AirfRANS: High Fidelity Computational Fluid Dynamics Dataset for Approximating Reynolds-Averaged Navier-Stokes Solutionscited by 77
- 2025Improving the Diffusability of Autoencoderscited by 74
- 2023DeAR: Debiasing Vision-Language Models with Additive Residualscited by 70
- 2023ALIP: Adaptive Language-Image Pre-training with Synthetic Captioncited by 70
50 most cited of 308 All 308 (JSON)
- 2026Syn-Omni: Structured Specialization and Progressive Collaboration for Omnimodal Embeddings8 Oct 2026
- 2026Seeing as Humans Do: Learning from Motion to Segment Anything Without Supervision30 Sep 2026
- 2026PhyProbe: Rethinking Physical Consistency Evaluation in Generated Videos29 Sep 2026
- 2026DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Model27 Sep 2026
- 2026Human-JEPA: A Human-Centric Vision Model that Perceives and Anticipates21 Aug 2026
- 2026A Controlled Study of Self-Supervised Image and Video Pretraining under Limited Resources13 Aug 2026
- 2026FitAQA: A Benchmark of Fitness Action Quality Assessment for Multimodal Large Language Models9 Aug 2026
- 2026Self-Supervised Learning of Structured Dynamics from Videos23 Jul 2026
- 2026Probing Identity-Specific Motion Signatures: A Controlled Diagnostic Study3 Jul 2026
- 2026LUMINA-26: Low-Light Understanding for Modeling and Interpreting Night-time Actions22 Jun 2026
- 2026Robust Zero-Shot Generalization for Open-Vocabulary Action Recognition via Task Arithmetic17 Jun 2026
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
38 more
- 2026Appearance-Invariant Detection of Suggestive Motion via Laban Movement Descriptors23 May 2026
- 2026The TIME Machine: On The Power of Motion for Efficient Perception21 May 2026
- 2026Cambrian-P: Pose-Grounded Video Understanding21 May 2026
- 2026From Human Videos to Robot Manipulation: A Survey on Scalable Vision-Language-Action Learning with Human-Centric Data18 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026VideoNet: A Large-Scale Dataset for Domain-Specific Action Recognition4 May 2026
- 2026HumanScore: Benchmarking Human Motions in Generated Videos22 Apr 2026
- 2026EFlow: Fast Few-Step Video Generator Training from Scratch via Efficient Solution Flow28 Mar 2026
- 2026A Skill-augmented Agentic Framework and Benchmark for Multi-Video Understanding16 Mar 2026
- 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learning15 Mar 2026
- 2026One Model, Many Budgets: Elastic Latent Interfaces for Diffusion Transformers12 Mar 2026
- 2026Flow3r: Factored Flow Prediction for Scalable Visual Geometry Learning23 Feb 2026
- 2026Exploring Real-Time Super-Resolution: Benchmarking and Fine-Tuning for Streaming Content11 Feb 2026
- 2026A Universal Action Space for General Behavior Analysis10 Feb 2026
- 2026CoWTracker: Tracking by Warping instead of Correlation4 Feb 2026
- 2026EventFlash: Towards Efficient MLLMs for Event-Based Vision3 Feb 2026
- 2025Open Ad-hoc Categorization with Contextualized Feature Learning18 Dec 2025
- 2025Recurrent Video Masked Autoencoders15 Dec 2025
- 2025Robust Motion Generation using Part-level Reliable Data from Videos14 Dec 2025
- 2025Generative Action Tell-Tales: Assessing Human Motion in Synthesized Videos1 Dec 2025
- 2025InternVideo-Next: Towards General Video Foundation Models without Video-Text Supervision1 Dec 2025
- 2025EventBench: Towards Comprehensive Benchmarking of Event-based MLLMs23 Nov 2025
- 2025ViMix-14M: A Curated Multi-Source Video-Text Dataset with Long-Form, High-Quality Captions and Crawl-Free Access23 Nov 2025
- 2025A Step Toward World Models: A Survey on Robotic Manipulation31 Oct 2025
- 2025LongCat-Flash-Omni Technical Report31 Oct 2025
- 2025Towards Universal Video Retrieval: Generalizing Video Embedding via Synthesized Multimodal Pyramid Curriculum31 Oct 2025
- 2025A Comprehensive Survey on World Models for Embodied AI19 Oct 2025
- 2025StretchySnake: Flexible SSM Training Unlocks Action Recognition Across Spatio-Temporal Scales17 Oct 2025
- 2025Image-to-Video Transfer Learning based on Image-Language Foundation Models: A Comprehensive Survey12 Oct 2025
- 2025DynamicEval: Rethinking Evaluation for Dynamic Text-to-Video Synthesis8 Oct 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025UniVid: The Open-Source Unified Video Model29 Sep 2025
- 2025VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Pottery21 Sep 2025
- 2025InterPose: Learning to Generate Human-Object Interactions from Large-Scale Web Videos31 Aug 2025
- 2025No More Sibling Rivalry: Debiasing Human-Object Interaction Detection31 Aug 2025
- 2025Category-level Text-to-Image Retrieval Improved: Bridging the Domain Gap with Diffusion Models and Vision Encoders29 Aug 2025
- 2025Representation Learning with Adaptive Superpixel Coding21 Aug 2025
- 2025Survey of Vision-Language-Action Models for Embodied Manipulation21 Aug 2025
50 newest of 308 All 308 (JSON)
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2023DeAR: Debiasing Vision-Language Models with Additive Residualscited by 70
- 2025Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformerscited by 35
- 2025Mavors: Multi-granularity Video Representation for Multimodal Large Language Modelcited by 31
- 2024Let Go of Your Labels with Unsupervised Transfercited by 14
- 2025MotionSight: Boosting Fine-Grained Motion Understanding in Multimodal LLMscited by 11
- 2024DENOISER: Rethinking the Robustness for Open-Vocabulary Action Recognitioncited by 8
- 2025ActionArt: Advancing Multimodal Large Models for Fine-Grained Human-Centric Video Understandingcited by 7
- 2025iSafetyBench: A video-language benchmark for safety in industrial environmentcited by 5
- 2024Are Visual-Language Models Effective in Action Recognition? A Comparative Studycited by 4
12 most cited of 20 All 20 (JSON)
- 2026FitAQA: A Benchmark of Fitness Action Quality Assessment for Multimodal Large Language Models9 Aug 2026
- 2026A Skill-augmented Agentic Framework and Benchmark for Multi-Video Understanding16 Mar 2026
- 2026EventFlash: Towards Efficient MLLMs for Event-Based Vision3 Feb 2026
- 2025EventBench: Towards Comprehensive Benchmarking of Event-based MLLMs23 Nov 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025iSafetyBench: A video-language benchmark for safety in industrial environment1 Aug 2025
- 2025MotionSight: Boosting Fine-Grained Motion Understanding in Multimodal LLMs2 Jun 2025
- 2025ActionArt: Advancing Multimodal Large Models for Fine-Grained Human-Centric Video Understanding25 Apr 2025
- 2025Mavors: Multi-granularity Video Representation for Multimodal Large Language Model14 Apr 2025
- 2025Safeguarding Vision-Language Models: Mitigating Vulnerabilities to Gaussian Noise in Perturbation-based Attacks2 Apr 2025
- 2025Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers14 Mar 2025
- 2024Verb Mirage: Unveiling and Assessing Verb Concept Hallucinations in Multimodal Large Language Models6 Dec 2024
12 newest of 20 All 20 (JSON)
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2025Improving the Diffusability of Autoencoderscited by 74
- 2025EchoShot: Multi-Shot Portrait Video Generationcited by 28
- 2025OmniVDiff: Omni Controllable Video Diffusion for Generation and Understandingcited by 22
- 2025From Image to Video: An Empirical Study of Diffusion Representationscited by 14
- 2025Improving Progressive Generation with Decomposable Flow Matchingcited by 6
- 2024Investigating Memorization in Video Diffusion Modelscited by 5
- 2026One Model, Many Budgets: Elastic Latent Interfaces for Diffusion Transformerscited by 3
- 2026EFlow: Fast Few-Step Video Generator Training from Scratch via Efficient Solution Flowcited by 2
- 2025InterPose: Learning to Generate Human-Object Interactions from Large-Scale Web Videoscited by 1
- 2025Category-level Text-to-Image Retrieval Improved: Bridging the Domain Gap with Diffusion Models and Vision Encoderscited by 0
- 2026EFlow: Fast Few-Step Video Generator Training from Scratch via Efficient Solution Flow28 Mar 2026
- 2026One Model, Many Budgets: Elastic Latent Interfaces for Diffusion Transformers12 Mar 2026
- 2025InterPose: Learning to Generate Human-Object Interactions from Large-Scale Web Videos31 Aug 2025
- 2025Category-level Text-to-Image Retrieval Improved: Bridging the Domain Gap with Diffusion Models and Vision Encoders29 Aug 2025
- 2025Improving Progressive Generation with Decomposable Flow Matching24 Jun 2025
- 2025EchoShot: Multi-Shot Portrait Video Generation16 Jun 2025
- 2025OmniVDiff: Omni Controllable Video Diffusion for Generation and Understanding15 Apr 2025
- 2025Improving the Diffusability of Autoencoders20 Feb 2025
- 2025From Image to Video: An Empirical Study of Diffusion Representations10 Feb 2025
- 2024Investigating Memorization in Video Diffusion Models29 Oct 2024
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model31 Aug 2022
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 65
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2025A Step Toward World Models: A Survey on Robotic Manipulationcited by 15
- 2024A Survey on Future Frame Synthesis: Bridging Deterministic and Generative Approachescited by 7
- 2025InternVideo-Next: Towards General Video Foundation Models without Video-Text Supervisioncited by 6
- 2025Can VLMs Predict Future States? Bootstrapping World Models from Inverse Dynamicscited by 2
- 2026DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Modelcited by 0
- 2026DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Model27 Sep 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2025InternVideo-Next: Towards General Video Foundation Models without Video-Text Supervision1 Dec 2025
- 2025A Step Toward World Models: A Survey on Robotic Manipulation31 Oct 2025
- 2025A Comprehensive Survey on World Models for Embodied AI19 Oct 2025
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun 2025
- 2025Can VLMs Predict Future States? Bootstrapping World Models from Inverse Dynamics6 Jun 2025
- 2024A Survey on Future Frame Synthesis: Bridging Deterministic and Generative Approaches26 Jan 2024
- 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb 2021
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
- 2025VaseVQA: Multimodal Agent and Benchmark for Ancient Greek Pottery21 Sep 2025
- 2025Magma: A Foundation Model for Multimodal AI Agents18 Feb 2025
- 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 325
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2021Transformers in Vision: A Surveycited by 1,009
- 2021Multiscale Vision Transformerscited by 896
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 573
- 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 516
- 2021Less is More: ClipBERT for Video-and-Language Learning via Sparse Samplingcited by 484
- 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 441
- 2021SLIP: Self-supervision meets Language-Image Pre-trainingcited by 434
- 2022Masked Autoencoders As Spatiotemporal Learnerscited by 428
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 377
12 most cited of 258 All 258 (JSON)
- 2026Syn-Omni: Structured Specialization and Progressive Collaboration for Omnimodal Embeddings8 Oct 2026
- 2026Seeing as Humans Do: Learning from Motion to Segment Anything Without Supervision30 Sep 2026
- 2026Human-JEPA: A Human-Centric Vision Model that Perceives and Anticipates21 Aug 2026
- 2026A Controlled Study of Self-Supervised Image and Video Pretraining under Limited Resources13 Aug 2026
- 2026Self-Supervised Learning of Structured Dynamics from Videos23 Jul 2026
- 2026Probing Identity-Specific Motion Signatures: A Controlled Diagnostic Study3 Jul 2026
- 2026LUMINA-26: Low-Light Understanding for Modeling and Interpreting Night-time Actions22 Jun 2026
- 2026Robust Zero-Shot Generalization for Open-Vocabulary Action Recognition via Task Arithmetic17 Jun 2026
- 2026Appearance-Invariant Detection of Suggestive Motion via Laban Movement Descriptors23 May 2026
- 2026The TIME Machine: On The Power of Motion for Efficient Perception21 May 2026
- 2026Cambrian-P: Pose-Grounded Video Understanding21 May 2026
- 2026VideoNet: A Large-Scale Dataset for Domain-Specific Action Recognition4 May 2026
12 newest of 258 All 258 (JSON)