VDCook:DIY video data cook your MLLMs
Not on the map. Why?
Abstract (arXiv)
We introduce VDCook: a self-evolving video data operating system, a configurable video data construction platform for researchers and vertical domain teams. Users initiate data requests via natural language queries and adjustable parameters (scale, retrieval-synthesis ratio, quality threshold). The system automatically performs query optimization, concurrently running real video retrieval and controlled synthesis modules. It ultimately generates in-domain data packages with complete provenance and metadata, along with reproducible Notebooks. Unlike traditional static, one-time-built datasets, VDCook enables continuous updates and domain expansion through its automated data ingestion mechanism based on MCP (Model Context Protocol)citemcp2024anthropic, transforming datasets into dynamically evolving open ecosystems. The system also provides multi-dimensional metadata annotation (scene segmentation, motion scoring, OCR ratio, automatic captioning, etc.), laying the foundation for flexible subsequent data `cooking' and indexingcitevlogger. This platform aims to significantly lower the barrier to constructing specialized video training datasets through infrastructure-level solutions, while supporting community contributions and a governance-enabled data expansion paradigm. Project demo: https://screenapp.io/app/v/WP0SvffgsH
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
20 of 28 references.
References · 20
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2024MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captionscited by 144
8 more
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 132
- 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 103
- 2017Coherent Online Video Style Transfercited by 96
- 2024V-Express: Conditional Dropout for Progressive Training of Portrait Video Generationcited by 85
- 2024Vlogger: Make Your Dream A Vlogcited by 70
- 2024VidGen-1M: A Large-Scale Dataset for Text-to-video Generationcited by 60
- 2025FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generationcited by 21
- 2025Negative Shanshui: Real-time Interactive Ink Painting Synthesiscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Raccoon: Multi-stage Diffusion Training with Coarse-to-Fine Curating Videos
- 2025Data Metabolism: An Efficient Data Design Schema For Vision Language Model
- 2026DataComp-VLM: Improved Open Datasets for Vision-Language Models
- 2024VidComposition: Can MLLMs Analyze Compositions in Compiled Videos?
- 2025Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models
- 2026DVBench: Benchmarking MLLMs for Understanding Dynamic Charts and Narratives in Data Videos
- 2024Needle In A Video Haystack: A Scalable Synthetic Evaluator for Video MLLMs
- 2025DIS-CO: Discovering Copyrighted Content in VLMs Training Data