EmoTrace-Bench: Diagnosing Emotional Expression in Text-to-Video Generation through Controlled Cues and Intensity
Not on the map. Why?
Abstract (arXiv)
Text-to-video (T2V) models are increasingly used to generate videos with targeted emotional expressions, yet existing evaluation methods mainly rely on holistic video-text alignment and provide limited insight into whether failures arise from target-emotion expression, intensity control, or specific affective cues. We introduce EmoTrace-Bench, a fine-grained diagnostic benchmark that controls emotion intensity and selected affective cues in prompts and evaluates generated videos at multiple levels. EmoTrace-Bench contains 448 controlled prompts covering eight emotions, two intensity levels, and diverse cue conditions. Using 12 T2V models, we generate 5,376 videos and evaluate target-emotion presence, perceived intensity, and ten audiovisual dimensions of emotional expression with an automated evaluator calibrated and validated against human annotations on a subset of the data. Results reveal substantial differences across models and prompt designs. Prompts that explicitly describe a character's emotional reaction are followed more reliably than prompts that describe only events or scenes, whereas adding more affective cues or using more explicit cinematic audiovisual language does not consistently improve emotional generation. These results illustrate how aggregate alignment scores may overlook localized differences in target-emotion expression, intensity control, and cue realization. EmoTrace-Bench provides a traceable and interpretable framework for diagnosing emotional video generation without modifying existing generation pipelines, and we release the prompts and the automated evaluation rules.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
13 of 32 references.
References · 13
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
- 2025Video-Bench: Human-Aligned Video Generation Benchmarkcited by 57
- 2025VABench: A Comprehensive Benchmark for Audio-Video Generationcited by 30
- 2025T2AV-Compass: Towards Unified Evaluation for Text-to-Audio-Video Generationcited by 24
- 2024EmoTalker: Emotionally Editable Talking Face Generation via Diffusion Modelcited by 12
- 2025Stable Cinemetrics : Structured Taxonomy and Evaluation for Professional Video Generationcited by 6
- 2026FilmBench: A Film-Grade Benchmark for Cinematic Video Generationcited by 3
- 2025EmoVid: A Multimodal Emotion Video Dataset for Emotion-Centric Video Understanding and Generationcited by 2
- 2026EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generationcited by 1
Built on by
Not cited yet.