mlsanityData to 7 Oct 2026

DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning

arXiv 2603.12257 ↗First posted 12 Mar 2026cs.CVcited by 4

On the map: Diffusion models → Video generation

Abstract (arXiv)

While large-scale diffusion models have revolutionized video synthesis, achieving precise control over both multi-subject identity and multi-granularity motion remains a significant challenge. Recent attempts to bridge this gap often suffer from limited motion granularity, control ambiguity, and identity degradation, leading to suboptimal performance on identity preservation and motion control. In this work, we present DreamVideo-Omni, a unified framework enabling harmonious multi-subject customization with omni-motion control via a progressive two-stage training paradigm. In the first stage, we integrate comprehensive control signals for joint training, encompassing subject appearances, global motion, local dynamics, and camera movements. To ensure robust and precise controllability, we introduce a condition-aware 3D rotary positional embedding to coordinate heterogeneous inputs and a hierarchical motion injection strategy to enhance global motion guidance. Furthermore, to resolve multi-subject ambiguity, we introduce group and role embeddings to explicitly anchor motion signals to specific identities, effectively disentangling complex scenes into independent controllable instances. In the second stage, to mitigate identity degradation, we design a latent identity reward feedback learning paradigm by training a latent identity reward model upon a pretrained video diffusion backbone. This provides motion-aware identity rewards in the latent space, prioritizing identity preservation aligned with human preferences. Supported by our curated large-scale dataset and the comprehensive DreamOmni Bench for multi-subject and omni-motion control evaluation, DreamVideo-Omni demonstrates superior performance in generating high-quality videos with precise controllability.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 98 of its 106 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

98 of 106 references.

Closest ancestors · 33

Same direction, newest first

  1. 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization16 Oct
  2. 2025Tora2: Motion and Appearance Customized Diffusion Transformer for Multi-Entity Video Generation8 Jul
  3. 2025VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Models27 Mar
  4. 2025VACE: All-in-One Video Creation and Editing10 Mar
  5. 2025CustomVideoX: 3D Reference Attention Driven Dynamic Adaptation for Zero-Shot Customized Video Diffusion Transformers10 Feb
  6. 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generation6 Feb
  7. 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuning8 Jan
  8. 2024VideoMaker: Zero-shot Customized Video Generation with the Inherent Force of Video Diffusion Models27 Dec
  9. 2024MotionShop: Zero-Shot Motion Transfer in Video Diffusion Models with Mixture of Score Guidance6 Dec
  10. 2024DIVE: Taming DINO for Subject-Driven Video Editing4 Dec
  11. 2024MoTrans: Customized Motion Transfer with Text-driven Video Diffusion Models2 Dec
  12. 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Model21 Oct
21 more
  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  2. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generation31 Jul
  3. 2024MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model30 May
  4. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation2 May
  5. 2024Spectral Motion Alignment for Video Motion Transfer using Diffusion Models22 Mar
  6. 2024DreamMotion: Space-Time Self-Similar Score Distillation for Zero-Shot Video Editing18 Mar
  7. 2024Customize-A-Video: One-Shot Motion Customization of Text-to-Video Diffusion Models22 Feb
  8. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion5 Feb
  9. 2024Motion-Zero: Zero-Shot Moving Object Control Framework for Diffusion-Based Video Generation18 Jan
  10. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjects18 Jan
  11. 2023TrailBlazer: Trajectory Control for Diffusion-Based Video Generation31 Dec
  12. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec
  13. 2023VMC: Video Motion Customization using Temporal Attention Adaption for Text-to-Video Diffusion Models1 Dec
  14. 2023VideoBooth: Diffusion-based Video Generation with Image Prompts1 Dec
  15. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
  16. 2023LAMP: Learn A Motion Pattern for Few-Shot-Based Video Generation16 Oct
  17. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models26 Sep
  18. 2023ModelScope Text-to-Video Technical Report12 Aug
  19. 2023Dreamix: Video Diffusion Models are General Video Editors2 Feb
  20. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation23 Nov
  21. 2022Video Diffusion Models7 Apr

Other references · 65

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  8. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  10. 2025Qwen3-VL Technical Reportcited by 2,534
  11. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  12. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
38 more
  1. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  2. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  3. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  4. 2017The 2017 DAVIS Challenge on Video Object Segmentationcited by 942
  5. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  6. 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 471
  7. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
  8. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  9. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
  10. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  11. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  12. 2023Recognize Anything: A Strong Image Tagging Modelcited by 305
  13. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  14. 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 260
  15. 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 224
  16. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
  17. 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
  18. 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
  19. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
  20. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  21. 2023Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfercited by 124
  22. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
  23. 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
  24. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 92
  25. 2023PEEKABOO: Interactive Video Generation via Masked-Diffusioncited by 76
  26. 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 76
  27. 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
  28. 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
  29. 2024Face Adapter for Pre-Trained Diffusion Models with Fine-Grained ID and Attribute Controlcited by 66
  30. 2025Multi-subject Open-set Personalization in Video Generationcited by 65
  31. 2024Image Conductor: Precision Control for Interactive Video Synthesiscited by 62
  32. 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 60
  33. 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
  34. 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 58
  35. 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 49
  36. 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 45
  37. 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
  38. 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 42

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025DualReal: Adaptive Joint Training for Lossless Identity-Motion Fusion in Video Customization
  2. 2023DreaMoving: A Human Video Generation Framework based on Diffusion Models
  3. 2025Proteus-ID: ID-Consistent and Motion-Coherent Video Customization
  4. 2026Tri-Prompting: Video Diffusion with Unified Control over Scene, Subject, and Motion
  5. 2025PolyVivid: Vivid Multi-Subject Video Generation with Cross-Modal Interaction and Enhancement
  6. 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning
  7. 2025Stable Video-Driven Portraits
  8. 2026AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation