AutoCut: End-to-end advertisement video editing based on multimodal discretization and controllable generation
Not on the map. Why?
Abstract (arXiv)
Short-form videos have become a primary medium for digital advertising, requiring scalable and efficient content creation. However, current workflows and AI tools remain disjoint and modality-specific, leading to high production costs and low overall efficiency. To address this issue, we propose AutoCut, an end-to-end advertisement video editing framework based on multimodal discretization and controllable editing. AutoCut employs dedicated encoders to extract video and audio features, then applies residual vector quantization to discretize them into unified tokens aligned with textual representations, constructing a shared video-audio-text token space. Built upon a foundation model, we further develop a multimodal large language model for video editing through combined multimodal alignment and supervised fine-tuning, supporting tasks covering video selection and ordering, script generation, and background music selection within a unified editing framework. Finally, a complete production pipeline converts the predicted token sequences into deployable long video outputs. Experiments on real-world advertisement datasets show that AutoCut reduces production cost and iteration time while substantially improving consistency and controllability, paving the way for scalable video creation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 36 of its 51 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
36 of 51 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
- 2024LITA: Language Instructed Temporal-Localization Assistantcited by 124
- 2020Condensed Movies: Story Based Retrieval with Contextual Embeddingscited by 95
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
- 2019Less is More: Learning Highlight Detection from Video Durationcited by 60
24 more
- 2023Shot2Story: A New Benchmark for Comprehensive Understanding of Multi-shot Videoscited by 54
- 2025UNIC: Unified In-Context Video Editingcited by 53
- 2024LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editingcited by 47
- 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generationcited by 39
- 2015Unsupervised Extraction of Video Highlights Via Robust Recurrent Auto-encoderscited by 30
- 2022The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assisted Video Editingcited by 24
- 2020Adaptive Video Highlight Detection by Learning from User Historycited by 22
- 2021Hierarchical Multimodal Transformer to Summarize Videoscited by 19
- 2023ReelFramer: Human-AI Co-Creation for News-to-Video Translationcited by 19
- 2024Synchronized Video Storytelling: Generating Video Narrations with Structured Storylinecited by 19
- 2025Music Flamingo: Scaling Music Understanding in Audio Language Modelscited by 19
- 2019B-Script: Transcript-based B-roll Video Editing with Recommendationscited by 16
- 2024ExpressEdit: Video Editing with Natural Language and Sketchingcited by 14
- 2021Transcript to Video: Efficient Clip Sequencing from Textscited by 13
- 2022Multi-modal Segment Assemblage Network for Ad Video Editing with Importance-Coherence Rewardcited by 10
- 2021DeepQAMVS: Query-Aware Hierarchical Pointer Networks for Multi-Video Summarizationcited by 8
- 2025VEU-Bench: Towards Comprehensive Understanding of Video Editingcited by 7
- 2025Text-to-Edit: Controllable End-to-End Video Ad Creation via Multimodal LLMscited by 6
- 2025From Shots to Stories: LLM-Assisted Video Editing with Unified Language Representationscited by 6
- 2025Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Mediacited by 6
- 2021Multi-modal Representation Learning for Video Advertisement Content Structuringcited by 5
- 2025Shot Sequence Ordering for Video Editing: Benchmarks, Metrics, and Cinematology-Inspired Computing Methodscited by 5
- 2025VC-LLM: Automated Advertisement Video Creation from Raw Footage using Multi-modal LLMscited by 3
- 2024Music Grounding by Short Videocited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generationcited by 0
- 2026Unified Agentic Video Editing Across Levels of Complexity and Creativitycited by 0
- 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detectioncited by 0
- 2026Memory-Guided B-Roll Generation from User Video Collectionscited by 0
- 2026Memory-Guided B-Roll Generation from User Video Collections1 Oct 2026
- 2026DF-CBM: Region-Aware Concept Bottleneck Models for Deepfake Detection28 Sep 2026
- 2026Unified Agentic Video Editing Across Levels of Complexity and Creativity11 Sep 2026
- 2026The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation2 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025From Long Videos to Engaging Clips: A Human-Inspired Video Editing Framework with Multimodal Narrative Understanding
- 2025SUMMA: A Multimodal Large Language Model for Advertisement Summarization
- 2026LoomVideo: Unifying Multimodal Inputs into Video Generation and Editing
- 2026Tele-Omni: a Unified Multimodal Framework for Video Generation and Editing
- 2026Edit-VAR: Taming Visual Autoregressive Model for Precise Video Editing
- 2025EditDuet: A Multi-Agent System for Video Non-Linear Editing
- 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructions
- 2026VEBench:Benchmarking Large Multimodal Models for Real-World Video Editing