A Benchmark and Multi-Agent System for Instruction-driven Cinematic Video Compilation
Not on the map. Why?
Abstract (arXiv)
The surging demand for adapting long-form cinematic content into short videos has motivated the need for versatile automatic video compilation systems. However, existing compilation methods are limited to predefined tasks, and the community lacks a comprehensive benchmark to evaluate the cinematic compilation. To address this, we introduce CineBench, the first benchmark for instruction-driven cinematic video compilation, featuring diverse user instructions and high-quality ground-truth compilations annotated by professional editors. To overcome contextual collapse and temporal fragmentation, we present CineAgents, a multi-agent system that reformulates cinematic video compilation into ``design-and-compose'' paradigm. CineAgents performs script reverse-engineering to construct a hierarchical narrative memory to provide multi-level context and employs an iterative narrative planning process that refines a creative blueprint into a final compiled script. Extensive experiments demonstrate that CineAgents significantly outperforms existing methods, generating compilations with superior narrative coherence and logical coherence.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 38 of its 51 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
38 of 51 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2023Visual Instruction Tuningcited by 7,869
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
26 more
- 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 326
- 2024Chain of Agents: Large Language Models Collaborating on Long-Context Taskscited by 206
- 2022Wespeaker: A Research and Production oriented Speaker Embedding Learning Toolkitcited by 97
- 2023Beyond Appearance: a Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Taskscited by 96
- 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
- 2024LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editingcited by 47
- 2020Learning Trailer Moments in Full-Length Moviescited by 37
- 2023AutoShot: A Short Video Dataset and State-of-the-Art Shot Boundary Detectioncited by 23
- 2025STAGE: Storyboard-Anchored Generation for Cinematic Multi-shot Narrativecited by 23
- 2020Rescribe: Authoring and Automatically Editing Audio Descriptionscited by 21
- 2023AVscript: Accessible Video Editing with Audio-Visual Scriptscited by 19
- 2021Learning to Cut by Watching Moviescited by 18
- 2022Boundary-aware Self-supervised Learning for Video Scene Segmentationcited by 17
- 2019B-Script: Transcript-based B-roll Video Editing with Recommendationscited by 16
- 2025EditDuet: A Multi-Agent System for Video Non-Linear Editingcited by 16
- 2021Transcript to Video: Efficient Clip Sequencing from Textscited by 13
- 2024Towards Automated Movie Trailer Generationcited by 9
- 2024A Reinforcement Learning-Based Automatic Video Editing Method Using Pre-trained Vision-Language Modelcited by 8
- 2025Lotus: Creating Short Videos From Long Videos With Abstractive and Extractive Summarizationcited by 6
- 2025From Long Videos to Engaging Clips: A Human-Inspired Video Editing Framework with Multimodal Narrative Understandingcited by 6
- 2025Towards Deeper Emotional Reflection: Crafting Affective Image Filters with Generative Priorscited by 6
- 2024Generative Timelines for Instructed Visual Assemblycited by 5
- 2023Collaborative Noisy Label Cleaner: Learning Scene-aware Trailers for Multi-modal Highlight Detection in Moviescited by 4
- 2025CineVerse: Consistent Keyframe Synthesis for Cinematic Scene Compositioncited by 4
- 2019Towards Data-Driven Automatic Video Editingcited by 2
- 2025Multi-modal and Metadata Capture Model for Micro Video Popularity Predictioncited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026MolMem: Memory-Augmented Agentic Reinforcement Learning for Sample-Efficient Molecular Optimizationcited by 4
- 2026BEAT: Rhythm-Elastic Alignment for Agentic Music-guided Movie Trailer Generationcited by 1
- 2026Crayotter: Traceable Multi-Agent Workflows for Long-Form Video Editingcited by 1
- 2026Crayotter: Learning Long-Horizon Video Editing Agents via Group-Relative Preference Backpropagationcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Productioncited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026FRAMEWORKERS: A Dynamic Multi-Agent Framework for AI-Generated Video Production30 Aug 2026
- 2026Crayotter: Learning Long-Horizon Video Editing Agents via Group-Relative Preference Backpropagation3 Aug 2026
- 2026Crayotter: Traceable Multi-Agent Workflows for Long-Form Video Editing31 May 2026
- 2026BEAT: Rhythm-Elastic Alignment for Agentic Music-guided Movie Trailer Generation26 May 2026
- 2026MolMem: Memory-Augmented Agentic Reinforcement Learning for Sample-Efficient Molecular Optimization14 Apr 2026