mlsanityData to 14 Oct 2026

MSG Score: Automated Video Verification for Reliable Multi-Scene Generation

arXiv 2411.19121 ↗First posted 28 Nov 2024cs.CV cs.AIcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

While text-to-video diffusion models have advanced significantly, creating coherent long-form content remains unreliable due to stochastic sampling artifacts. This necessitates generating multiple candidates, yet verifying them creates a severe bottleneck; manual review is unscalable, and existing automated metrics lack the adaptability and speed required for runtime monitoring. Another critical issue is the trade-off between evaluation quality and run-time performance: metrics that best capture human-like judgment are often too slow to support iterative generation. These challenges, originating from the lack of an effective evaluation, motivate our work toward a novel solution. To address this, we propose a scalable automated verification framework for long-form video. First, we introduce the MSG(Multi-Scene Generation) score, a hierarchical attention-based metric that adaptively evaluates narrative and visual consistency. This serves as the core verifier within our CGS (Candidate Generation and Selection) framework, which automatically identifies and filters high-quality outputs. Furthermore, we introduce Implicit Insight Distillation (IID) to resolve the trade-off between evaluation reliability and inference speed, distilling complex metric insights into a lightweight student model. Our approach offers the first comprehensive solution for reliable and scalable long-form video production.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 13 of its 14 references that are in the map. First posted on arXiv 28 Nov 2024.

Builds on

13 of 14 references.

References · 13

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  5. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  6. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  9. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  10. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  11. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
  12. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
1 more
  1. 2024AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMMcited by 24

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026MSVBench: Towards Human-Level Evaluation of Multi-Shot Video Generation
  2. 2024Towards A Better Metric for Text-to-Video Generation
  3. 2025VideoScore2: Think before You Score in Generative Video Evaluation
  4. 2025AIGVE-MACS: Unified Multi-Aspect Commenting and Scoring Model for AI-Generated Video Evaluation
  5. 2026DirectorBench: Diagnosing Long-Form Video Generation with Personalized Multi-Agent Evaluation
  6. 2026Detecting AI-Generated Video: A Vision-Language Dual-View Survey
  7. 2026MSAVBench: Towards Comprehensive and Reliable Evaluation of Multi-Shot Audio-Video Generation
  8. 2025SeqBench: Benchmarking Sequential Narrative Generation in Text-to-Video Models