mlsanityData to 7 Oct 2026

BEACON: Behavior and Appearance Control for Subject-Specific Video Generation

arXiv 2609.13264 ↗First posted 7 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Generating human-centric videos that preserve both visual identity and person-specific expressive behavior remains a fundamental challenge. In addition to reproducing appearance, a model must replicate the facial behaviors that characterize how a subject expresses emotion over time. However, most state-of-the-art methods condition generation on a single reference image, which contains no information about these temporal dynamics. As a result, they tend to preserve the subject's visual identity but often produce expressions with limited variation and weak subject specificity. To mitigate this issue, we introduce BEACON, a lightweight framework for person-specific video generation that produces more expressive videos by disentangling visual identity from expressive behavior. BEACON conditions generation on two complementary signals: a reference image encoding the identity and a reference video capturing subject-specific facial dynamics. By conditioning on these complementary signals, BEACON generates videos that better preserve both the subject's appearance and characteristic facial dynamics, while also supporting identity-expression transfer. Our experiments on the MEAD and RAVDESS datasets show that by fine-tuning on approximately 2,000 pairs and updating about 1% of the pretrained Wan video diffusion model, BEACON improves facial expressivity over state-of-the-art video generation methods while maintaining competitive identity preservation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 23 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

17 of 23 references.

References · 17

  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  4. 2019Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Setcited by 481
  5. 2025VACE: All-in-One Video Creation and Editingcited by 467
  6. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  7. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  8. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  9. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
  10. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  11. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
  12. 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
5 more
  1. 2024TalkingGaussian: Structure-Persistent 3D Talking Head Synthesis via Gaussian Splattingcited by 60
  2. 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
  3. 2025Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generationcited by 27
  4. 2026Slot-ID: Identity-Preserving Video Generation from Reference Videos via Slot-Based Temporal Identity Encodingcited by 4
  5. 2021Weakly Supervised Learning for Facial Affective Behavior Analysis : A Reviewcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025FaceCrafter: Identity-Conditional Diffusion with Disentangled Control over Facial Pose, Expression, and Emotion
  2. 2025SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformers
  3. 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization
  4. 2024Towards a Simultaneous and Granular Identity-Expression Control in Personalized Face Generation
  5. 2025FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint
  6. 2026Avatar V: Scaling Video-Reference Avatar Video Generation
  7. 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers
  8. 2026ExpPortrait: Expressive Portrait Generation via Personalized Representation