EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generation
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Emotion shapes how viewers interpret a scene, yet existing video generators entangle global atmosphere, affect-bearing semantic cues, and temporal progression within a single text condition. We present EmoWorld, a framework that decouples these factors within a frozen flow-matching video diffusion transformer (Video DiT). A one-time preparation stage extracts layer-specific affect directions and a reusable cue library from geometry-preserving neutral and emotion-edited panoramas. At inference, Visual Atmosphere Steering (VAS) injects atmosphere directions into hidden states, Semantic Affective Steering (SAS) isolates a separately scalable prompt residual for semantic cues, and Temporal Affective Steering (TAS) interpolates endpoint residual fields across denoising and video time. On Wan2.2, VAS improves target-emotion alignment by 19% while reducing a temporal-fluctuation proxy by 48%; SAS improves target-emotion alignment by 37% and increases detected affect-bearing cues by 36%; and TAS improves transition monotonicity by 15% over the strongest baseline. EmoWorld is evaluated across 27 emotion categories in text-to-video and image-to-video settings, demonstrates portability across multiple Video-DiT backbones, and supports camera-conditioned composition without updating generator parameters.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 33 of its 52 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
33 of 52 references.
Closest ancestors · 1
Same direction, newest first
Other references · 32
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 492
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 327
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
20 more
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2024Training-free Camera Control for Video Generationcited by 122
- 2023RAVE: Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Modelscited by 114
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
- 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 82
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
- 2024Video Diffusion Models are Training-free Motion Interpreter and Controllercited by 61
- 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
- 2025Matrix-3D: Omnidirectional Explorable 3D World Generationcited by 35
- 2024EmoEdit: Evoking Emotions through Image Manipulationcited by 30
- 2025EmotiCrafter: Text-to-Emotional-Image Generation based on Valence-Arousal Modelcited by 26
- 2025FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editingcited by 26
- 2025UniEmo: Unifying Emotional Understanding and Generation with Learnable Expert Queriescited by 18
- 2025MoEE: Mixture of Emotion Experts for Audio-Driven Portrait Animationcited by 12
- 2026Versatile Editing of Video Content, Actions, and Dynamics without Trainingcited by 4
- 2025EmoAgent: A Multi-Agent Framework for Diverse Affective Image Manipulationcited by 3
- 2025PanoDreamer: Consistent Text to 360-Degree Scene Generationcited by 3
- 2026Activation Steering of Video Generation Models via Reduced-Order Linear Optimal Controlcited by 3
- 2026TunerDiT: Training-free Progressive Steering of Diffusion Transformer for Multi-Event Video Generationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026EmoScene: A Dual-space Dataset for Controllable Affective Image Generation
- 2026EmoSpace: Immersive Affective Image Generation Guided by Fine-Grained Emotion Prototypes
- 2026Benchmarking Dynamic Affective Reasoning: A Viewer-Centric Video Emotion Dataset
- 2026Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring
- 2025EmoCtrl: Controllable Emotional Image Content Generation
- 2025MUSE: Manipulating Unified Framework for Synthesizing Emotions in Images via Test-Time Optimization
- 2024StimuVAR: Spatiotemporal Stimuli-aware Video Affective Reasoning with Multimodal Large Language Models
- 2026EmoKGEdit: Training-free Affective Injection via Visual Cue Transformation