RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation
Not on the map. Why?
Abstract (arXiv)
Cross-identity character animation aims to drive a target identity from a reference image to follow the motion of a source character from a driving video. The core challenge lies in the inherent entanglement of two capabilities: cross-identity spatial mapping (aligning position, scale, and skeletal proportions) and motion control (refining joint articulation, volumetric consistency, and view coherence). We introduce Reference-Aware Structural Alignment (RASA), a framework that disentangles spatial mapping from motion control by injecting structured priors into a Diffusion Transformer (DiT). Our approach has two stages. First, a Spatial Prior Calibrator (SPC) fuses reference identity with driving pose to generate a spatially grounded initial noise latent, ensuring correct positioning, scaling, and alignment with the driving skeleton. Second, an Inherent Motional Guider (IMG) encodes shape-agnostic SMPL articulation parameters into a semantic motion vector beyond appearance-biased 2D keypoints. Injected into intermediate DiT layers, this vector complements the base pose condition for anatomically consistent articulation and view-aware volumetric refinement. We curate CIM-Bench, a high-quality benchmark with rigorous curation, for evaluation. Extensive experiments show RASA significantly outperforms state-of-the-art methods in motion fidelity and visual quality. Our work establishes a new paradigm showing disentangled spatial and motional priors are key to robust character animation. Project page: https://hidream.ai.github.io/RASA/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 46 of its 58 references that are in the map. First posted on arXiv 28 Aug 2026.
Builds on
46 of 58 references.
References · 46
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
34 more
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusioncited by 167
- 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 158
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 131
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
- 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 76
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
- 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 60
- 2024Score-Guided Diffusion for 3D Human Recoverycited by 39
- 2025HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generationcited by 38
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2026HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformercited by 29
- 2025RealisDance-DiT: Simple yet Strong Baseline towards Controllable Character Animation in the Wildcited by 28
- 2024MotionStone: Decoupled Motion Intensity Modulation with Diffusion Transformer for Image-to-Video Generationcited by 16
- 2025StableAnimator++: Overcoming Pose Misalignment and Face Distortion for Human Image Animationcited by 12
- 2025Animate-X++: Universal Character Image Animation with Dynamic Backgroundscited by 10
- 2025SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservationcited by 10
- 2025TokenMotion: Decoupled Motion Control via Token Disentanglement for Human-centric Video Generationcited by 9
- 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfercited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DreamActor-M2: Universal Character Image Animation via Spatiotemporal In-Context Learning
- 2026AnyCrowd: Instance-Isolated Identity-Pose Binding for Arbitrary Multi-Character Animation
- 2026IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation
- 2026MultiAnimate: Pose-Guided Image Animation Made Extensible
- 2025Stable Video-Driven Portraits
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioning
- 2026MoSAIC: Aligned Intervention Supervision for Part-Local Motion Style Transfer
- 2026Wan-Animate-2: Pushing the Application Boundaries of Character Animation