mlsanityData to 14 Oct 2026

BEAT: Rhythm-Elastic Alignment for Agentic Music-guided Movie Trailer Generation

arXiv 2605.27067 ↗First posted 26 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Automatic movie trailer generation must select shots from a full-length film and synchronize them with background music. Existing methods either relegate music alignment to post-processing or enforce rigid one-to-one shot-music mappings, overlooking that professional editing rhythm is elastic: rapid cuts accompany high-energy passages while sustained shots span quieter bars. We introduce BEAT, a framework that addresses this gap with two core components: MuVA, a compact music-visual alignment encoder trained with Sinkhorn-regularized two-stage learning, and Bar-DP, an energy-adaptive dynamic programming algorithm that produces elastic many-to-one alignments following musical dynamics. These components are integrated into a five-phase agentic pipeline that grounds the core alignment in learned cross-modal features while coordinating higher-level creative decisions through structured text signals. To support comprehensive evaluation, we also introduce TrailerArena, a benchmark with 20+ metrics across four complementary dimensions. On TrailerArena, BEAT achieves state-of-the-art performance across shot selection, ordering, and perceptual quality, while producing fully composed trailers end-to-end.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 43 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

27 of 43 references.

References · 27

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  5. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  6. 2025Qwen-Image Technical Reportcited by 1,044
  7. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
  8. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 171
  9. 2021CLIP-It! Language-Guided Video Summarizationcited by 99
  10. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
  11. 2018Summarizing Videos with Attentioncited by 69
  12. 2024LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editingcited by 47
15 more
  1. 2024VidMuse: A Simple Video-to-Music Generation Framework with Long-Short-Term Modelingcited by 40
  2. 2023All-In-One Metrical And Functional Structure Analysis With Neighborhood Attentions on Demixed Audiocited by 28
  3. 2025FilmAgent: A Multi-Agent Framework for End-to-End Film Automation in Virtual 3D Spacescited by 28
  4. 2020Movie Summarization via Sparse Graph Constructioncited by 22
  5. 2025EditDuet: A Multi-Agent System for Video Non-Linear Editingcited by 16
  6. 2021Finding the Right Moment: Human-Assisted Trailer Creation via Task Compositioncited by 12
  7. 2024Towards Automated Movie Trailer Generationcited by 9
  8. 2026DIRECT: Video Mashup Creation via Hierarchical Multi-Agent Planning and Intent-Guided Editingcited by 7
  9. 2025From Shots to Stories: LLM-Assisted Video Editing with Unified Language Representationscited by 6
  10. 2025Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Mediacited by 6
  11. 2026CutClaw: Agentic Hours-Long Video Editing via Music Synchronizationcited by 6
  12. 2026A Benchmark and Multi-Agent System for Instruction-driven Cinematic Video Compilationcited by 6
  13. 2024An Inverse Partial Optimal Transport Framework for Music-guided Movie Trailer Generationcited by 4
  14. 2025Self-Paced and Self-Corrective Masked Prediction for Movie Trailer Generationcited by 2
  15. 2026Trailer Reimagined: An Innovative, Llm-DRiven, Expressive Automated Movie Summary framework (TRAILDREAMS)cited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Let Your Video Listen to Your Music!
  2. 2026JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions
  3. 2026VIBE: Video Instruction-aligned Background music gEneration
  4. 2024Harmonizing Pixels and Melodies: Maestro-Guided Film Score Generation and Composition Style Transfer
  5. 2024MuVi: Video-to-Music Generation with Semantic Alignment and Rhythmic Synchronization
  6. 2023Long-Term Rhythmic Video Soundtracker
  7. 2026Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generation
  8. 2025AutoMV: An Automatic Multi-Agent System for Music Video Generation