mlsanityData to 7 Oct 2026

NarraScore: Bridging Visual Narrative and Musical Dynamics via Hierarchical Affective Control

arXiv 2602.09070 ↗First posted 9 Feb 2026cs.SD cs.AI eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Synthesizing coherent soundtracks for long-form videos remains a formidable challenge, currently stalled by three critical impediments: computational scalability, temporal coherence, and, most critically, a pervasive semantic blindness to evolving narrative logic. To bridge these gaps, we propose NarraScore, a hierarchical framework predicated on the core insight that emotion serves as a high-density compression of narrative logic. Uniquely, we repurpose frozen Vision-Language Models (VLMs) as continuous affective sensors, distilling high-dimensional visual streams into dense, narrative-aware Valence-Arousal trajectories. Mechanistically, NarraScore employs a Dual-Branch Injection strategy to reconcile global structure with local dynamism: a textitGlobal Semantic Anchor ensures stylistic stability, while a surgical textitToken-Level Affective Adapter modulates local tension via direct element-wise residual injection. This minimalist design bypasses the bottlenecks of dense attention and architectural cloning, effectively mitigating the overfitting risks associated with data scarcity. Experiments demonstrate that NarraScore achieves state-of-the-art consistency and narrative alignment with negligible computational overhead, establishing a fully autonomous paradigm for long-video soundtrack generation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 28 of its 47 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

28 of 47 references.

References · 28

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  3. 2018SlowFast Networks for Video Recognitioncited by 1,862
  4. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  5. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  6. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  7. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
  8. 2023VideoMAE V2: Scaling Video Masked Autoencoders with Dual Maskingcited by 516
  9. 2023MusicLM: Generating Music From Textcited by 442
  10. 2025Improving Video Generation with Human Feedbackcited by 267
  11. 2025Video models are zero-shot learners and reasonerscited by 208
  12. 2020AVLnet: Learning Audio-Visual Language Representations from Instructional Videoscited by 110
16 more
  1. 2019Music Source Separation in the Waveform Domaincited by 98
  2. 2020Foley Music: Learning to Generate Music from Videoscited by 82
  3. 2018Aff-Wild2: Extending the Aff-Wild Database for Affect Recognitioncited by 80
  4. 2021Video Background Music Generation with Controllable Music Transformercited by 55
  5. 2023Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer modelcited by 37
  6. 2023Learning Emotion Representations from Verbal and Nonverbal Communicationcited by 31
  7. 2023V2Meow: Meowing to the Visual Beat via Video-to-Music Generationcited by 18
  8. 2024VMAS: Video-to-Music Generation via Semantic Alignment in Web Music Videoscited by 14
  9. 2024MuVi: Video-to-Music Generation with Semantic Alignment and Rhythmic Synchronizationcited by 14
  10. 2023VEATIC: Video-based Emotion and Affect Tracking in Context Datasetcited by 12
  11. 2024MusiConGen: Rhythm and Chord Control for Transformer-Based Text-to-Music Generationcited by 11
  12. 2025GVMGen: A General Video-to-Music Generation Model with Hierarchical Attentionscited by 9
  13. 2025A Comprehensive Survey on Generative AI for Video-to-Music Generationcited by 4
  14. 2025Controllable Video-to-Music Generation with Multiple Time-Varying Conditionscited by 3
  15. 2025Video Echoed in Music: Semantic, Temporal, and Rhythmic Alignment for Video-to-Music Generationcited by 3
  16. 2025Video Soundtrack Generation by Aligning Emotions and Temporal Boundariescited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Interpreting and Enhancing Emotional Circuits in Large Vision-Language Models via Cross-Modal Information Flow
  2. 2026JenBridge: Adaptive Long-Form Video Soundtracking across Scene Transitions
  3. 2025MUSE: Manipulating Unified Framework for Synthesizing Emotions in Images via Test-Time Optimization
  4. 2026Semantic visually-guided acoustic highlighting with large vision-language models
  5. 2026EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generation
  6. 2026BackgroundMellow: A Multi-Modal Cohesive Framework for Narrative-Driven Rich Cinematic Soundscape Generation
  7. 2026Directing the Narrative: A Finetuning Method for Controlling Coherence and Style in Story Generation
  8. 2025Learning to Hear by Seeing: It's Time for Vision Language Models to Understand Artistic Emotion from Sight and Sound