ViMix-14M: A Curated Multi-Source Video-Text Dataset with Long-Form, High-Quality Captions and Crawl-Free Access
Not on the map. Why?
Abstract (arXiv)
Text-to-video generation has surged in interest since Sora, yet open-source models still face a data bottleneck: there is no large, high-quality, easily obtainable video-text corpus. Existing public datasets typically require manual YouTube crawling, which yields low usable volume due to link rot and access limits, and raises licensing uncertainty. This work addresses this challenge by introducing ViMix-14M, a curated multi-source video-text dataset of around 14 million pairs that provides crawl-free, download-ready access and long-form, high-quality captions tightly aligned to video. ViMix-14M is built by merging diverse open video sources, followed by unified de-duplication and quality filtering, and a multi-granularity, ground-truth-guided re-captioning pipeline that refines descriptions to better match actions, scenes, and temporal structure. We evaluate the dataset by multimodal retrieval, text-to-video generation, and video question answering tasks, observing consistent improvements over counterpart datasets. We hope this work can help removing the key barrier to training and fine-tuning open-source video foundation models, and provide insights of building high-quality and generalizable video-text datasets.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 51 of its 60 references that are in the map. First posted on arXiv 23 Nov 2025.
Builds on
51 of 60 references.
References · 51
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Visual Instruction Tuningcited by 7,869
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
38 more
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024Qwen2 Technical Reportcited by 2,120
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2023VideoChat: Chat-Centric Video Understandingcited by 857
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
- 2023DataComp: In search of the next generation of multimodal datasetscited by 644
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 619
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
- 2018A Short Note about Kinetics-600cited by 333
- 2021MERLOT: Multimodal Neural Script Knowledge Modelscited by 311
- 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 310
- 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 280
- 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
- 2023Unmasked Teacher: Towards Training-Efficient Video Foundation Modelscited by 199
- 2015A Dataset for Movie Descriptioncited by 195
- 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
- 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
- 2024VidGen-1M: A Large-Scale Dataset for Text-to-video Generationcited by 62
- 2021ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learningcited by 50
- 2022Learning to Decompose Visual Features with Latent Textual Promptscited by 28
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Infinite Worlds with Versatile Interactionscited by 48
- 2026Parallel Decoding Distillation for Fast Image and Video Generationcited by 10
- 2026Beyond Closed-Pool Video Retrieval: A Benchmark and Agent Framework for Real-World Video Search and Moment Localizationcited by 3
- 2026CodecCap: High-Fidelity Codec-Inspired Residual Modeling for Dense Video Captioningcited by 0
- 2026LAION-BVD: A 10-Million-Hour Open Video Dataset for Multimodal Pre-trainingcited by 0
- 2026Parametric Trajectory Distillation for Few-Step Video Generationcited by 0
- 2026Parametric Trajectory Distillation for Few-Step Video Generation8 Oct 2026
- 2026LAION-BVD: A 10-Million-Hour Open Video Dataset for Multimodal Pre-training25 Aug 2026
- 2026Parallel Decoding Distillation for Fast Image and Video Generation28 Jul 2026
- 2026Infinite Worlds with Versatile Interactions8 Jul 2026
- 2026CodecCap: High-Fidelity Codec-Inspired Residual Modeling for Dense Video Captioning26 May 2026
- 2026Beyond Closed-Pool Video Retrieval: A Benchmark and Agent Framework for Real-World Video Search and Moment Localization10 Feb 2026