mlsanityData to 7 Oct 2026

RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation

arXiv 2608.28219 ↗First posted 28 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Cross-identity character animation aims to drive a target identity from a reference image to follow the motion of a source character from a driving video. The core challenge lies in the inherent entanglement of two capabilities: cross-identity spatial mapping (aligning position, scale, and skeletal proportions) and motion control (refining joint articulation, volumetric consistency, and view coherence). We introduce Reference-Aware Structural Alignment (RASA), a framework that disentangles spatial mapping from motion control by injecting structured priors into a Diffusion Transformer (DiT). Our approach has two stages. First, a Spatial Prior Calibrator (SPC) fuses reference identity with driving pose to generate a spatially grounded initial noise latent, ensuring correct positioning, scaling, and alignment with the driving skeleton. Second, an Inherent Motional Guider (IMG) encodes shape-agnostic SMPL articulation parameters into a semantic motion vector beyond appearance-biased 2D keypoints. Injected into intermediate DiT layers, this vector complements the base pose condition for anatomically consistent articulation and view-aware volumetric refinement. We curate CIM-Bench, a high-quality benchmark with rigorous curation, for evaluation. Extensive experiments show RASA significantly outperforms state-of-the-art methods in motion fidelity and visual quality. Our work establishes a new paradigm showing disentangled spatial and motional priors are key to robust character animation. Project page: https://hidream.ai.github.io/RASA/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 58 references that are in the map. First posted on arXiv 28 Aug 2026.

Builds on

46 of 58 references.

References · 46

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  9. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  10. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  12. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
34 more
  1. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  2. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  3. 2025VACE: All-in-One Video Creation and Editingcited by 467
  4. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
  5. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  6. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  7. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  8. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
  9. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  10. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
  11. 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
  12. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 158
  13. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
  14. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
  15. 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
  16. 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
  17. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
  18. 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
  19. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
  20. 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
  21. 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
  22. 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
  23. 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 60
  24. 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
  25. 2025HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generationcited by 38
  26. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  27. 2026HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformercited by 29
  28. 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
  29. 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
  30. 2025StableAnimator++: Overcoming Pose Misalignment and Face Distortion for Human Image Animationcited by 12
  31. 2025Animate-X++: Universal Character Image Animation with Dynamic Backgroundscited by 10
  32. 2025SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservationcited by 10
  33. 2025TokenMotion: Decoupled Motion Control via Token Disentanglement for Human-centric Video Generationcited by 9
  34. 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfercited by 9

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning
  2. 2026AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation
  3. 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation
  4. 2026MultiAnimate: Pose-Guided Image Animation Made Extensible
  5. 2025Stable Video-Driven Portraits
  6. 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioning
  7. 2026MoSAIC: Aligned Intervention Supervision for Part-Local Motion Style Transfer
  8. 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animation