mlsanityData to 14 Oct 2026

ViMix-14M: A Curated Multi-Source Video-Text Dataset with Long-Form, High-Quality Captions and Crawl-Free Access

arXiv 2511.18382 ↗First posted 23 Nov 2025cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Text-to-video generation has surged in interest since Sora, yet open-source models still face a data bottleneck: there is no large, high-quality, easily obtainable video-text corpus. Existing public datasets typically require manual YouTube crawling, which yields low usable volume due to link rot and access limits, and raises licensing uncertainty. This work addresses this challenge by introducing ViMix-14M, a curated multi-source video-text dataset of around 14 million pairs that provides crawl-free, download-ready access and long-form, high-quality captions tightly aligned to video. ViMix-14M is built by merging diverse open video sources, followed by unified de-duplication and quality filtering, and a multi-granularity, ground-truth-guided re-captioning pipeline that refines descriptions to better match actions, scenes, and temporal structure. We evaluate the dataset by multimodal retrieval, text-to-video generation, and video question answering tasks, observing consistent improvements over counterpart datasets. We hope this work can help removing the key barrier to training and fine-tuning open-source video foundation models, and provide insights of building high-quality and generalizable video-text datasets.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 51 of its 60 references that are in the map. First posted on arXiv 23 Nov 2025.

Builds on

51 of 60 references.

References · 51

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  8. 2025Qwen2.5-VL Technical Reportcited by 5,587
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  10. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  11. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  12. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
38 more
  1. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  2. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  3. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2024Qwen2 Technical Reportcited by 2,120
  7. 2017The Kinetics Human Action Video Datasetcited by 1,909
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  9. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  10. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  12. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  13. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  14. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  15. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  16. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
  17. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  18. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
  19. 2023VideoChat: Chat-Centric Video Understandingcited by 857
  20. 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
  21. 2023DataComp: In search of the next generation of multimodal datasetscited by 644
  22. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
  23. 2017Towards Automatic Learning of Procedures from Web Instructional Videoscited by 619
  24. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  25. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
  26. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  27. 2018A Short Note about Kinetics-600cited by 333
  28. 2021MERLOT: Multimodal Neural Script Knowledge Modelscited by 311
  29. 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 310
  30. 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 280
  31. 2021Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptionscited by 226
  32. 2023Unmasked Teacher: Towards Training-Efficient Video Foundation Modelscited by 199
  33. 2015A Dataset for Movie Descriptioncited by 195
  34. 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
  35. 2023Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generationcited by 154
  36. 2024VidGen-1M: A Large-Scale Dataset for Text-to-video Generationcited by 62
  37. 2021ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learningcited by 50
  38. 2022Learning to Decompose Visual Features with Latent Textual Promptscited by 28

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.