A Short Note about Kinetics-600
Not on the map. Why?
Cited by 21 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We describe an extension of the DeepMind Kinetics human action dataset from 400 classes, each with at least 400 video clips, to 600 classes, each with at least 600 video clips. In order to scale up the dataset we changed the data collection process so it uses multiple queries per class, with some of them in a language other than english -- portuguese. This paper details the changes between the two versions of the dataset and includes a comprehensive set of statistics of the new version as well as baseline results using the I3D neural network architecture. The paper is a companion to the release of the ground truth labels for the public test set.
Key facts. Cited by 331 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 45; 2022: 76; 2023: 64; 2024: 67; 2025: 52; 2026: 27.
331 papers.
Sort:
By area:
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2022Video Diffusion Modelscited by 2,280
- 2021ViViT: A Video Vision Transformercited by 1,610
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2021Multiscale Vision Transformerscited by 896
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
38 more
- 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 573
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
- 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 441
- 2022Masked Autoencoders As Spatiotemporal Learnerscited by 428
- 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 427
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 377
- 2022MAGVIT: Masked Generative Video Transformercited by 341
- 2024VideoMamba: State Space Model for Efficient Video Understandingcited by 325
- 2022Expanding Language-Image Pretrained Models for General Video Recognitioncited by 320
- 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 310
- 2023Photorealistic Video Generation with Diffusion Modelscited by 304
- 2023Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistlescited by 287
- 2021A Large-Scale Study on Unsupervised Spatiotemporal Representation Learningcited by 214
- 2022UniFormer: Unifying Convolution and Self-attention for Visual Recognitioncited by 206
- 2023A Survey on Video Diffusion Modelscited by 203
- 2023Video Understanding with Large Language Models: A Surveycited by 203
- 2023Unmasked Teacher: Towards Training-Efficient Video Foundation Modelscited by 199
- 2022ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learningcited by 192
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2022MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognitioncited by 189
- 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networkscited by 186
- 2022MERLOT Reserve: Neural Script Knowledge through Vision and Language and Soundcited by 184
- 2022UniFormer: Unified Transformer for Efficient Spatiotemporal Representation Learningcited by 182
- 2021Adaptive Token Sampling For Efficient Vision Transformerscited by 181
- 2022Fine-tuned CLIP Models are Efficient Video Learnerscited by 178
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 177
- 2021SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioningcited by 161
- 2021Towards Long-Form Video Understandingcited by 146
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2021MoViNets: Mobile Video Networks for Efficient Video Recognitioncited by 135
- 2022Diffusion Models for Video Prediction and Infillingcited by 134
- 2023FETV: A Benchmark for Fine-Grained Evaluation of Open-Domain Text-to-Video Generationcited by 119
- 2024OmniTokenizer: A Joint Image-Video Tokenizer for Visual Generationcited by 117
- 2022UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormercited by 116
- 2021Broaden Your Views for Self-Supervised Video Learningcited by 108
- 2022Long Movie Clip Classification with State-Space Video Modelscited by 106
- 2023Selective Structured State-Spaces for Long-Form Video Understandingcited by 105
50 most cited of 331 All 331 (JSON)
- 2026Moving Beyond More Views: Redundancy-Aware Ego-Exo Fusion for Proficiency Estimation26 Aug 2026
- 2026Beyond Instrument Motion: Recognizing Tissue Tension Toward Surgical Skill Assessment18 Aug 2026
- 2026V-RAE: Rethinking Video Latent Spaces for Generation13 Aug 2026
- 2026WaiT for the Signal: Simple Frequency-Aware Flow-Matching30 Jul 2026
- 2026FlashDecoder: Real-Time Latent-to-Pixel Streaming Decoder with Transformers16 Jul 2026
- 2026VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders15 Jul 2026
- 2026Probing Identity-Specific Motion Signatures: A Controlled Diagnostic Study3 Jul 2026
- 2026TACO: Towards Task-Consistent Open-Vocabulary Adaptation in Video Recognition24 Jun 2026
- 2026Modality-Aware Out-of-Distribution Detection for Multi-Modal Action Recognition23 Jun 2026
- 2026LUMINA-26: Low-Light Understanding for Modeling and Interpreting Night-time Actions22 Jun 2026
- 2026TivTok: Broadcasting Time-Invariant Tokens for Scalable Video Tokenization16 Jun 2026
- 2026MVEB: Massive Video Embedding Benchmark12 Jun 2026
38 more
- 2026OmniGen-AR: AutoRegressive Any-to-Image Generation8 Jun 2026
- 2026Toward Native Multimodal Modeling: A Roadmap25 May 2026
- 2026Spatio-Temporal Similarity Volume Aggregation for Open-Vocabulary Action Recognition22 May 2026
- 2026Cambrian-P: Pose-Grounded Video Understanding21 May 2026
- 2026USV: Towards Understanding the User-generated Short-form Videos20 May 2026
- 2026EAST: Early Action Prediction Sampling Strategy with Token Masking20 Apr 2026
- 2026Motion-Guided Semantic Alignment with Negative Prompts for Zero-Shot Video Action Recognition18 Apr 2026
- 2026From Pixels to Nucleotides: End-to-End Token-Based Video Compression for DNA Storage15 Apr 2026
- 2026VideoFlexTok: Flexible-Length Coarse-to-Fine Video Tokenization14 Apr 2026
- 2026ABMAMBA: Multimodal Large Language Model with Aligned Hierarchical Bidirectional Scan for Efficient Video Captioning9 Apr 2026
- 2026From Skeletons to Semantics: Design and Deployment of a Hybrid Edge-Based Action Detection System for Public Safety31 Mar 2026
- 2026SportSkills: Physical Skill Learning from Sports Instructional Videos26 Mar 2026
- 2026EVATok: Adaptive Length Video Tokenization for Efficient Visual Autoregressive Generation12 Mar 2026
- 2026Learning Compact Video Representations for Efficient Long-form Video Understanding in Large Multimodal Models19 Feb 2026
- 2026A Universal Action Space for General Behavior Analysis10 Feb 2026
- 2025Unleashing Foundation Vision Models: Adaptive Transfer for Diverse Data-Limited Scientific Domains27 Dec 2025
- 2025Pushing the Frontier of Audiovisual Perception with Large-Scale Multimodal Correspondence Learning22 Dec 2025
- 2025Flowception: Temporally Expansive Flow Matching for Video Generation12 Dec 2025
- 2025DeRA: Decoupled Representation Alignment for Video Tokenization4 Dec 2025
- 2025InternVideo-Next: Towards General Video Foundation Models without Video-Text Supervision1 Dec 2025
- 2025TRoVe: Discovering Error-Inducing Static Feature Biases in Temporal Vision-Language Models30 Nov 2025
- 2025Smooth regularization for efficient video recognition25 Nov 2025
- 2025ViMix-14M: A Curated Multi-Source Video-Text Dataset with Long-Form, High-Quality Captions and Crawl-Free Access23 Nov 2025
- 2025Learning Skill-Attributes for Transferable Assessment in Video17 Nov 2025
- 2025DetectiumFire: A Comprehensive Multi-modal Dataset Bridging Vision and Language for Fire Understanding4 Nov 2025
- 2025Enhancing Spatio-Temporal Zero-shot Action Recognition with Language-driven Description Attributes31 Oct 2025
- 2025EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoT27 Oct 2025
- 2025ImagerySearch: Adaptive Test-Time Search for Video Generation Beyond Semantic Dependency Constraints16 Oct 2025
- 2025CanvasMAR: Improving Masked Autoregressive Video Prediction With Canvas15 Oct 2025
- 2025Image-to-Video Transfer Learning based on Image-Language Foundation Models: A Comprehensive Survey12 Oct 2025
- 2025Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Tools9 Oct 2025
- 2025Bridging Text and Video Generation: A Survey6 Oct 2025
- 2025DC-VideoGen: Efficient Video Generation with Deep Compression Video Autoencoder29 Sep 2025
- 2025Constrained Prompt Enhancement for Improving Zero-Shot Generalization of Vision-Language Models24 Aug 2025
- 2025Text as Any-Modality for Zero-Shot Classification by Consistent Prompt Tuning8 Aug 2025
- 2025Adapting Vision-Language Models Without Labels: A Comprehensive Survey7 Aug 2025
- 2025SPACT18: Spiking Human Action Recognition Benchmark Dataset with Complementary RGB and Thermal Modalities22 Jul 2025
- 2025RefTok: Reference-Based Tokenization for Video Generation3 Jul 2025
50 newest of 331 All 331 (JSON)
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2022Revisiting Classifier: Transferring Vision-Language Models for Video Recognitioncited by 70
- 2022Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Modelscited by 48
- 2024AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportationcited by 27
- 2025Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Toolscited by 23
- 2024Distilling Vision-Language Models on Millions of Videoscited by 20
- 2023OST: Refining Text Knowledge with Optimal Spatio-Temporal Descriptor for General Video Recognitioncited by 16
- 2023Video Action Recognition with Attentive Semantic Unitscited by 12
- 2024VG4D: Vision-Language Model Goes 4D Video Recognitioncited by 11
- 2024Efficient Test-Time Prompt Tuning for Vision-Language Modelscited by 9
- 2024Exploring Scalability of Self-Training for Open-Vocabulary Temporal Action Localizationcited by 6
- 2024Text-Enhanced Zero-Shot Action Recognition: A training-free approachcited by 6
12 most cited of 21 All 21 (JSON)
- 2026ABMAMBA: Multimodal Large Language Model with Aligned Hierarchical Bidirectional Scan for Efficient Video Captioning9 Apr 2026
- 2026Learning Compact Video Representations for Efficient Long-form Video Understanding in Large Multimodal Models19 Feb 2026
- 2025TRoVe: Discovering Error-Inducing Static Feature Biases in Temporal Vision-Language Models30 Nov 2025
- 2025Enhancing Spatio-Temporal Zero-shot Action Recognition with Language-driven Description Attributes31 Oct 2025
- 2025Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Tools9 Oct 2025
- 2025Constrained Prompt Enhancement for Improving Zero-Shot Generalization of Vision-Language Models24 Aug 2025
- 2025Adapting Vision-Language Models Without Labels: A Comprehensive Survey7 Aug 2025
- 2025Is Temporal Prompting All We Need For Limited Labeled Action Recognition?2 Apr 2025
- 2025TEST-V: TEst-time Support-set Tuning for Zero-shot Video Classification1 Feb 2025
- 2025From My View to Yours: Learning Egocentric Cues from Exocentric Video using Privileged Egocentric Supervision10 Jan 2025
- 2024Text-Enhanced Zero-Shot Action Recognition: A training-free approach29 Aug 2024
- 2024Efficient Test-Time Prompt Tuning for Vision-Language Models11 Aug 2024
12 newest of 21 All 21 (JSON)
- 2022Video Diffusion Modelscited by 2,280
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
- 2023Photorealistic Video Generation with Diffusion Modelscited by 304
- 2023A Survey on Video Diffusion Modelscited by 203
- 2022Scalable Adaptive Computation for Iterative Generationcited by 190
- 2022Diffusion Models for Video Prediction and Infillingcited by 134
- 2024Rolling Diffusion Modelscited by 102
- 2024Improved Video VAE for Latent Video Diffusion Modelcited by 46
- 2024Video Diffusion Models: A Surveycited by 28
- 2025LeanVAE: An Ultra-Efficient Reconstruction VAE for Video Diffusion Modelscited by 15
- 2025VFRTok: Variable Frame Rates Video Tokenizer with Duration-Proportional Information Assumptioncited by 4
- 2025Flowception: Temporally Expansive Flow Matching for Video Generationcited by 2
12 most cited of 14 All 14 (JSON)
- 2026WaiT for the Signal: Simple Frequency-Aware Flow-Matching30 Jul 2026
- 2026FlashDecoder: Real-Time Latent-to-Pixel Streaming Decoder with Transformers16 Jul 2026
- 2025Flowception: Temporally Expansive Flow Matching for Video Generation12 Dec 2025
- 2025VFRTok: Variable Frame Rates Video Tokenizer with Duration-Proportional Information Assumption17 May 2025
- 2025LeanVAE: An Ultra-Efficient Reconstruction VAE for Video Diffusion Models18 Mar 2025
- 2024Improved Video VAE for Latent Video Diffusion Model10 Nov 2024
- 2024Video Diffusion Models: A Survey6 May 2024
- 2024Rolling Diffusion Models12 Feb 2024
- 2023Photorealistic Video Generation with Diffusion Models11 Dec 2023
- 2023A Survey on Video Diffusion Models16 Oct 2023
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation9 Oct 2023
- 2022Scalable Adaptive Computation for Iterative Generation22 Dec 2022
12 newest of 14 All 14 (JSON)
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2022MAGVIT: Masked Generative Video Transformercited by 341
- 2025Video-GPT via Next Clip Diffusioncited by 8
- 2025InternVideo-Next: Towards General Video Foundation Models without Video-Text Supervisioncited by 6
- 2026Toward Native Multimodal Modeling: A Roadmapcited by 6
- 2026Toward Native Multimodal Modeling: A Roadmap25 May 2026
- 2025InternVideo-Next: Towards General Video Foundation Models without Video-Text Supervision1 Dec 2025
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun 2025
- 2025Video-GPT via Next Clip Diffusion18 May 2025
- 2022MAGVIT: Masked Generative Video Transformer10 Dec 2022
- 2023ADAPT: Action-aware Driving Caption Transformercited by 78
- 2023ADAPT: Action-aware Driving Caption Transformer1 Feb 2023
- 2024Video Token Merging for Long-form Video Understandingcited by 22
- 2024Video Token Merging for Long-form Video Understanding31 Oct 2024
- 2021ViViT: A Video Vision Transformercited by 1,610
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2021Multiscale Vision Transformerscited by 896
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 573
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
- 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 441
12 most cited of 283 All 283 (JSON)
- 2026Moving Beyond More Views: Redundancy-Aware Ego-Exo Fusion for Proficiency Estimation26 Aug 2026
- 2026Beyond Instrument Motion: Recognizing Tissue Tension Toward Surgical Skill Assessment18 Aug 2026
- 2026V-RAE: Rethinking Video Latent Spaces for Generation13 Aug 2026
- 2026VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders15 Jul 2026
- 2026Probing Identity-Specific Motion Signatures: A Controlled Diagnostic Study3 Jul 2026
- 2026TACO: Towards Task-Consistent Open-Vocabulary Adaptation in Video Recognition24 Jun 2026
- 2026Modality-Aware Out-of-Distribution Detection for Multi-Modal Action Recognition23 Jun 2026
- 2026LUMINA-26: Low-Light Understanding for Modeling and Interpreting Night-time Actions22 Jun 2026
- 2026TivTok: Broadcasting Time-Invariant Tokens for Scalable Video Tokenization16 Jun 2026
- 2026MVEB: Massive Video Embedding Benchmark12 Jun 2026
- 2026OmniGen-AR: AutoRegressive Any-to-Image Generation8 Jun 2026
- 2026Spatio-Temporal Similarity Volume Aggregation for Open-Vocabulary Action Recognition22 May 2026
12 newest of 283 All 283 (JSON)