From Video Clips to Creation Trajectory: Sora100K for AI-Native Video Creation
Not on the map. Why?
Abstract (arXiv)
AI-Native video creation is shifting from isolated video clips toward iterative video creation workflows. However, existing datasets remain largely video clips, representing video generation and editing as separate tasks rather than connected stages of a video creation workflow. In this paper, we introduce Sora100K, a dataset that represents the AI-Native video creation workflow as a structured video creation trajectory. Specifically, we first identify video creation trajectories and decompose them into three subsets according to their structural roles: text-to-video generation records as roots, single-turn video editing records as editing edges, and multi-turn video editing records as complete trajectories. Then, we use a VLM to assign semantic annotations for generation roots and editing-operation annotations for editing edges. A strict construction pipeline further reconstructs source-to-edit lineage, editing order, and intermediate video states while ensuring data quality. Finally, we perform lightweight adaptation on LTX-2 models to assess the supervision value of Sora100K. The results show improvements in visual quality, multi-shot generation, and cross-shot consistency, while successive-turn evaluation reveals that following multi-turn editing instructions remains challenging. Sora100K establishes a new data foundation for AI-Native video creation beyond isolated video clips and toward structured video creation trajectory. The dataset and supplementary materials are publicly available at https://huggingface.co/datasets/ysicong/Sora100K.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 9 of its 31 references that are in the map. First posted on arXiv 8 Oct 2026.
Builds on
9 of 31 references.
References · 9
- 2025Qwen2.5-VL Technical Reportcited by 5,499
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 223
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 151
- 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
- 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 51
- 2026MOVA: Towards Scalable and Synchronized Video-Audio Generationcited by 41
- 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 24
- 2026OmniNFT: Modality-wise Omni Diffusion Reinforcement for Joint Audio-Video Generationcited by 7
- 2026Memory-V2V: Memory-Augmented Video-to-Video Diffusion for Consistent Multi-Turn Editingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing
- 2024RACCooN: A Versatile Instructional Video Editing Framework with Auto-Generated Narratives
- 2026InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptation
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects
- 2024Video Is Worth a Thousand Images: Exploring the Latest Trends in Long Video Generation
- 2026LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editing
- 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing
- 2024Open-Sora: Democratizing Efficient Video Production for All